greybet.com
robots.txt

Robots Exclusion Standard data for greybet.com

Resource Scan

Scan Details

Site Domain greybet.com
Base Domain greybet.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-01-19T23:45:13+00:00
Next Scan 2025-04-19T23:45:13+00:00

Last Successful Scan

Scanned2024-08-30T23:09:09+00:00
URL https://greybet.com/robots.txt
Domain IPs 104.21.58.151, 172.67.205.44, 2606:4700:3034::6815:3a97, 2606:4700:3036::ac43:cd2c
Response IP 104.21.58.151
Found Yes
Hash 1bd345753ad6df564957098266c63377d63e97dc4744ab706073664b837561c8
SimHash 4a21180089b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-content/uploads/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://greybet.com/sitemap_index.xml