mygodisgay.com
robots.txt

Robots Exclusion Standard data for mygodisgay.com

Resource Scan

Scan Details

Site Domain mygodisgay.com
Base Domain mygodisgay.com
Scan Status Ok
Last Scan2024-06-19T04:56:43+00:00
Next Scan 2024-07-03T04:56:43+00:00

Last Scan

Scanned2024-06-19T04:56:43+00:00
URL https://mygodisgay.com/robots.txt
Domain IPs 104.21.3.122, 172.67.130.176, 2606:4700:3030::6815:37a, 2606:4700:3037::ac43:82b0
Response IP 172.67.130.176
Found Yes
Hash 13b3ecd0ba0e75995d29e9d60a33124c96fa89ee8d3994485db04318ffcad5f4
SimHash ca0c8460f689

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /actions

panscient.com

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

netestate

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

dotbot
dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot
ahrefsbot
mj12bot
semrushbot
dotbot
babbar
bytespider
amazonbot
serpstatbot
barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mygodisgay.com/sitemap.xml

Comments

  • http://www.website-datenbank.de/
  • http://www.opensiteexplorer.org/dotbot