gamblingindustrynews.com
robots.txt

Robots Exclusion Standard data for gamblingindustrynews.com

Resource Scan

Scan Details

Site Domain gamblingindustrynews.com
Base Domain gamblingindustrynews.com
Scan Status Ok
Last Scan2024-09-09T01:40:35+00:00
Next Scan 2024-10-09T01:40:35+00:00

Last Scan

Scanned2024-09-09T01:40:35+00:00
URL https://gamblingindustrynews.com/robots.txt
Domain IPs 104.21.10.246, 172.67.164.213, 2606:4700:3030::6815:af6, 2606:4700:3033::ac43:a4d5
Response IP 104.21.10.246
Found Yes
Hash ea616ccd2a46d6b203b341d850d0cae66005f36a3fb6c410875783cc212ed5c4
SimHash d616c160b411

Groups

*

Rule Path
Disallow /cdn-cgi/

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /