Log In Sign Up

efty.net
robots.txt

Robots Exclusion Standard data for efty.net

Resource Scan

Scan Details

Site Domain efty.net
Base Domain efty.net
Scan Status Ok
Last Scan2025-04-06T20:54:33+00:00
Next Scan 2025-05-06T20:54:33+00:00

Last Scan

Scanned2025-04-06T20:54:33+00:00
URL https://efty.net/robots.txt
Domain IPs 35.208.5.102
Response IP 35.208.5.102
Found Yes
Hash 13934a15e52e82637d6f69189f47381be3a4a2f55f9dca3d389872c4d3623dc6
SimHash 4814d880e392

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly)
Back to top