roboleary.net
robots.txt

Robots Exclusion Standard data for roboleary.net

Resource Scan

Scan Details

Site Domain roboleary.net
Base Domain roboleary.net
Scan Status Ok
Last Scan2024-06-02T10:08:14+00:00
Next Scan 2024-07-02T10:08:14+00:00

Last Scan

Scanned2024-06-02T10:08:14+00:00
URL https://roboleary.net/robots.txt
Redirect https://www.roboleary.net/robots.txt
Redirect Domain www.roboleary.net
Redirect Base roboleary.net
Domain IPs 13.215.144.61, 13.228.199.255, 2406:da18:880:3800::c8, 2406:da18:b3d:e200::64
Redirect IPs 13.251.96.10, 2406:da18:880:3800::c8, 2406:da18:b3d:e201::64, 46.137.195.11
Response IP 13.251.96.10
Found Yes
Hash 65000cea031243ae667ee0b01359cb3cf6b42f8ba7ae8c5bf83fd91ce0ad0b40
SimHash 0610486aa6b2

Groups

*

Rule Path
Disallow /drafts/
Disallow /private/

adsbot-google

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgili

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.roboleary.net/sitemap.xml