onionsearchengine.com
robots.txt

Robots Exclusion Standard data for onionsearchengine.com

Resource Scan

Scan Details

Site Domain onionsearchengine.com
Base Domain onionsearchengine.com
Scan Status Ok
Last Scan2024-09-26T15:07:26+00:00
Next Scan 2024-10-03T15:07:26+00:00

Last Scan

Scanned2024-09-26T15:07:26+00:00
URL https://onionsearchengine.com/robots.txt
Domain IPs 172.66.40.252, 172.66.43.4
Response IP 172.66.40.252
Found Yes
Hash 7f542b38adc4ac2cce922caf33b7c6b7872d9ac6b7654023c4f9ad0cc92f26f3
SimHash a51142926795

Groups

*

Rule Path
Disallow /matomo
Disallow /paste
Disallow /adv
Disallow /ads
Disallow /*?

ia_archiver

Rule Path
Disallow /

Comments

  • No search result pages
  • User-agent: bingbot
  • Allow: /$
  • Disallow: /*?
  • User-agent: msnbot
  • Allow: /$
  • Disallow: /*?