Touch-up Documentation and Script User Agent
This commit is contained in:
parent
831c176875
commit
388ac935f1
|
@ -1,3 +1,3 @@
|
||||||
# searX-py-job-scraper (WIP NOT COMPLETE)
|
# searX-py-job-scraper (WIP NOT COMPLETE)
|
||||||
|
|
||||||
Dump job listings, to a CSV, scraped from searX instances.
|
Dump job listings, to a CSV, scraped from searX instances. [A convenient list of all active public searX hosts.](https://searx.space/)
|
||||||
|
|
|
@ -27,7 +27,7 @@ HEADERS = [
|
||||||
'sec-fetch-site: same-origin',
|
'sec-fetch-site: same-origin',
|
||||||
'sec-fetch-user: ?1',
|
'sec-fetch-user: ?1',
|
||||||
'upgrade-insecure-requests: 1',
|
'upgrade-insecure-requests: 1',
|
||||||
'user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/113.0.0.0 Safari/537.36'
|
'user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36'
|
||||||
]
|
]
|
||||||
|
|
||||||
#Populate this list with your favourite searX hosts
|
#Populate this list with your favourite searX hosts
|
||||||
|
|
Loading…
Reference in New Issue
Block a user