Log In Sign Up

bookmangame.com
robots.txt

Robots Exclusion Standard data for bookmangame.com

Resource Scan

Scan Details

Site Domain bookmangame.com
Base Domain bookmangame.com
Scan Status Ok
Last Scan2024-06-30T01:49:53+00:00
Next Scan 2024-07-07T01:49:53+00:00

Last Scan

Scanned2024-06-30T01:49:53+00:00
URL https://bookmangame.com/robots.txt
Domain IPs 104.21.88.97, 172.67.176.75, 2606:4700:3030::6815:5861, 2606:4700:3036::ac43:b04b
Response IP 104.21.88.97
Found Yes
Hash 71209bb6974dc5b51d5fbcf4af816ab349f8e357c798969df3ce16b7a6fba3f6
SimHash 8211440a2f63

Groups

mediapartners-google*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

bender

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

msrbot

Rule Path
Disallow /

open*

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

scooter*

Rule Path
Disallow /

websearch*

Rule Path
Disallow /

zyborg*

Rule Path
Disallow /

wget*

Rule Path
Disallow /

turnitinbot*

Rule Path
Disallow /

slysearch*

Rule Path
Disallow /

seekbot*

Rule Path
Disallow /

netresearchserver*

Rule Path
Disallow /

seekbot*

Rule Path
Disallow /

mozdex*

Rule Path
Disallow /

link*

Rule Path
Disallow /

larbin*

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

charlotte

Rule Path
Disallow /
Back to top