streamdebate.wordpress.com
robots.txt

Robots Exclusion Standard data for streamdebate.wordpress.com

Resource Scan

Scan Details

Site Domain streamdebate.wordpress.com
Base Domain wordpress.com
Scan Status Ok
Last Scan2024-05-11T15:11:11+00:00
Next Scan 2024-06-10T15:11:11+00:00

Last Scan

Scanned2024-05-11T15:11:11+00:00
URL https://streamdebate.wordpress.com/robots.txt
Redirect https://streamdebate.com/robots.txt
Redirect Domain streamdebate.com
Redirect Base streamdebate.com
Domain IPs 192.0.78.12, 192.0.78.13
Redirect IPs 192.0.78.137, 192.0.78.216
Response IP 192.0.78.216
Found Yes
Hash bebbb4dca82a5c2e256d08b38ab261c1db4c012b223b8d6d2f64738b681fab6b
SimHash 6a144842a156

Groups

*

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /