thegamecrafter.com
robots.txt

Robots Exclusion Standard data for thegamecrafter.com

Resource Scan

Scan Details

Site Domain thegamecrafter.com
Base Domain thegamecrafter.com
Scan Status Ok
Last Scan2025-08-14T10:45:53+00:00
Next Scan 2025-09-13T10:45:53+00:00

Last Scan

Scanned2025-08-14T10:45:53+00:00
URL https://thegamecrafter.com/robots.txt
Redirect https://www.thegamecrafter.com/robots.txt
Redirect Domain www.thegamecrafter.com
Redirect Base thegamecrafter.com
Domain IPs 3.219.157.115, 52.2.32.196, 54.157.92.177
Redirect IPs 3.219.157.115, 52.2.32.196, 54.157.92.177
Response IP 3.219.157.115
Found Yes
Hash 73b475bd36ffea29f101c0e739684c6964281e7ee61c785e9be9f0fbc5cd3e90
SimHash f05dc0d25e30

Groups

*

Rule Path
Disallow /cart

*

Rule Path
Disallow /deal/

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /