mharb/py-searX-job-scraper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Touch-up Documentation and Script User Agent

Browse Source
This commit is contained in:
mharb 2023-10-02 20:26:25 -04:00 committed by mharb
parent 831c176875
commit 388ac935f1
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -1,3 +1,3 @@
# searX-py-job-scraper (WIP NOT COMPLETE)
Dump job listings, to a CSV, scraped from searX instances.
Dump job listings, to a CSV, scraped from searX instances. [A convenient list of all active public searX hosts.](https://searx.space/)

2
job_scraper.py
View File

@ -27,7 +27,7 @@ HEADERS = [
'sec-fetch-site: same-origin',
'sec-fetch-user: ?1',
'upgrade-insecure-requests: 1',
'user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/113.0.0.0 Safari/537.36'
'user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36'
]
#Populate this list with your favourite searX hosts