policyandsociety.org
robots.txt

Robots Exclusion Standard data for policyandsociety.org

Resource Scan

Scan Details

Site Domain policyandsociety.org
Base Domain policyandsociety.org
Scan Status Ok
Last Scan2024-05-26T12:51:44+00:00
Next Scan 2024-06-25T12:51:44+00:00

Last Scan

Scanned2024-05-26T12:51:44+00:00
URL https://policyandsociety.org/robots.txt
Redirect https://thepokies83australia.net/robots.txt
Redirect Domain thepokies83australia.net
Redirect Base thepokies83australia.net
Domain IPs 2a00:f940:2:2:1:1:0:106, 37.140.192.12
Redirect IPs 104.21.88.233, 172.67.153.192, 2606:4700:3034::ac43:99c0, 2606:4700:3035::6815:58e9
Response IP 172.67.153.192
Found Yes
Hash 52c91e81fa9ec466e619e0fd15834ea36debbf067b10fb771a8cb13061912a81
SimHash 600449612137

Groups

*

Rule Path
Allow /

ccbot
google-extended
gptbot
chatgpt-user
omgilibot
omgili
facebookbot
anthropic-ai
cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://thepokies83australia.net/sitemap.xml