annotate requirements.txt @ 33:9e4eb3f2754e

Improve handling of character limits in html stripping The code now more closely keeps track of character counts during html stripping, and should be absolutely exact. When the limit is exceeded, it now restarts the stripping without any URLs to prevent incorrect trimming. It also better preserves whitespace in the original post. New tests are added for Twitter silo to ensure it works as expected.
author Ludovic Chabant <ludovic@chabant.com>
date Wed, 10 May 2023 16:10:12 -0700
parents 6a014f7c6eea
children c5f73ebb43a5
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
31
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
1 -i https://pypi.python.org/simple
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
2 beautifulsoup4==4.12.2
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
3 blurhash==1.1.4
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
4 certifi==2023.5.7
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
5 charset-normalizer==3.1.0
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
6 coloredlogs==15.0.1
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
7 decorator==5.1.1
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
8 future==0.18.3
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
9 html5lib==1.1
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
10 humanfriendly==10.0
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
11 idna==3.4
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
12 mastodon.py==1.8.1
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
13 mf2py==1.1.2
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
14 mf2util==0.5.2
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
15 oauthlib==3.2.2
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
16 python-dateutil==2.8.2
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
17 python-magic==0.4.27
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
18 python-twitter==3.5
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
19 requests==2.30.0
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
20 requests-oauthlib==1.3.1
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
21 ronkyuu==0.9
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
22 six==1.16.0
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
23 soupsieve==2.4.1
6a014f7c6eea Update dependencies and regen requirements
Ludovic Chabant <ludovic@chabant.com>
parents: 24
diff changeset
24 urllib3==2.0.2
0
a1b7a459326a Initial commit.
Ludovic Chabant <ludovic@chabant.com>
parents:
diff changeset
25 webencodings==0.5.1