Skip to content

Commit

Permalink
fix: add REQUEST_FINGERPRINTER_IMPLEMENTATION to settings to prevent …
Browse files Browse the repository at this point in the history
…deprecation warnings
  • Loading branch information
jasonbosco committed Dec 27, 2024
1 parent 679c127 commit aad6771
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion scraper/src/index.py
Original file line number Diff line number Diff line change
Expand Up @@ -101,7 +101,8 @@ def run_config(config):
# Use our custom dupefilter in order to be scheme agnostic regarding link provided
'DUPEFILTER_CLASS': DUPEFILTER_CLASS_PATH,
'DEFAULT_REQUEST_HEADERS': DEFAULT_REQUEST_HEADERS,
'TELNETCONSOLE_ENABLED': False
'TELNETCONSOLE_ENABLED': False,
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7'
})

process.crawl(
Expand Down

0 comments on commit aad6771

Please sign in to comment.