mathis-abdou.space
robots.txt

Robots Exclusion Standard data for mathis-abdou.space

Resource Scan

Scan Details

Site Domain mathis-abdou.space
Base Domain mathis-abdou.space
Scan Status Ok
Last Scan2025-06-15T12:02:20+00:00
Next Scan 2025-07-15T12:02:20+00:00

Last Scan

Scanned2025-06-15T12:02:20+00:00
URL http://mathis-abdou.space/robots.txt
Redirect https://mathis-abdou.weebly.com/robots.txt
Redirect Domain mathis-abdou.weebly.com
Redirect Base weebly.com
Domain IPs 192.64.119.114
Redirect IPs 74.115.51.8, 74.115.51.9
Response IP 74.115.51.9
Found Yes
Hash e0bf8701bc5af8ecfd12d4f5471c7dff3f3b63a456c43dea1b4a6bbaca26e9e8
SimHash 6a54dc746793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://mathis-abdou.weebly.com/sitemap.xml