wwgfa.info
robots.txt

Robots Exclusion Standard data for wwgfa.info

Resource Scan

Scan Details

Site Domain wwgfa.info
Base Domain wwgfa.info
Scan Status Ok
Last Scan2024-09-28T01:58:07+00:00
Next Scan 2024-10-28T01:58:07+00:00

Last Scan

Scanned2024-09-28T01:58:07+00:00
URL https://wwgfa.info/robots.txt
Domain IPs 216.239.136.187
Response IP 216.239.136.187
Found Yes
Hash e6a6facc9c800c8a4b26536121ee3316edd2610d55b31ec37caebae1212b0082
SimHash 523c4b4b8036

Groups

blexbot/1.0
ccbot
chatgpt-user
claudebot
claudebot/1.0
elisabot
gptbot
uptimerobot
uptimerobot/1.0
uptimerobot/2.0

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /