onionsearchengine.com
robots.txt

Robots Exclusion Standard data for onionsearchengine.com

Resource Scan

Scan Details

Site Domain onionsearchengine.com
Base Domain onionsearchengine.com
Scan Status Ok
Last Scan2024-11-14T15:11:29+00:00
Next Scan 2024-11-21T15:11:29+00:00

Last Scan

Scanned2024-11-14T15:11:29+00:00
URL https://onionsearchengine.com/robots.txt
Domain IPs 172.66.40.252, 172.66.43.4
Response IP 172.66.43.4
Found Yes
Hash 67fd0ac39e1aeca4bf59b61feac8d9819ab5f9c7e66feac5c3ed5207829685bf
SimHash a51142926795

Groups

*

Rule Path
Disallow /matomo
Disallow /paste
Disallow /adv
Disallow /ads
Disallow /*?

ia_archiver

Rule Path
Disallow /

Comments

  • No search result pages
  • User-agent: bingbot
  • Allow: /$
  • Disallow: /*?
  • User-agent: msnbot
  • Allow: /$
  • Disallow: /*?