edolls.net
robots.txt

Robots Exclusion Standard data for edolls.net

Resource Scan

Scan Details

Site Domain edolls.net
Base Domain edolls.net
Scan Status Ok
Last Scan2026-02-27T12:35:48+00:00
Next Scan 2026-03-29T12:35:48+00:00

Last Scan

Scanned2026-02-27T12:35:48+00:00
URL https://edolls.net/robots.txt
Domain IPs 104.21.75.46, 172.67.213.194, 2606:4700:3032::6815:4b2e, 2606:4700:3035::ac43:d5c2
Response IP 104.21.75.46
Found Yes
Hash 02687caa77b8cdb16ad8980a02acfff4e761448c6dbb86fefecce7bf922dcb7e
SimHash 3a1cdc42eeb2

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /log.php

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

go-http-client*

Rule Path
Disallow /

python-requests*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://edolls.net/sitemap.xml