Log In Sign Up

pewpewthespells.com
robots.txt

Robots Exclusion Standard data for pewpewthespells.com

Resource Scan

Scan Details

Site Domain pewpewthespells.com
Base Domain pewpewthespells.com
Scan Status Ok
Last Scan2024-10-06T12:43:20+00:00
Next Scan 2024-11-05T12:43:20+00:00

Last Scan

Scanned2024-10-06T12:43:20+00:00
URL https://pewpewthespells.com/robots.txt
Domain IPs 178.79.182.202, 2a01:7e00::f03c:91ff:fedb:2494
Response IP 178.79.182.202
Found Yes
Hash 4a9642033afee2a1dd8573b4aee2218b2369856f6cbf2126aff81da629a6cb4e
SimHash 121cc158efc3

Groups

spbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mpdmpra-search-bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

twitterbot/1.0

Rule Path
Disallow /

fever

Rule Path
Disallow /

openwebspider

Rule Path
Disallow /

bichoo spider

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

dbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

*

Rule Path
Disallow /archives/
Disallow /media/
Disallow /text/
Disallow /re/
Back to top

Comments

  • go away
Back to top