happyhooligans.com
robots.txt

Robots Exclusion Standard data for happyhooligans.com

Resource Scan

Scan Details

Site Domain happyhooligans.com
Base Domain happyhooligans.com
Scan Status Ok
Last Scan4/3/2025, 9:07:16 AM
Next Scan 5/3/2025, 9:07:16 AM

Last Scan

Scanned4/3/2025, 9:07:16 AM
URL https://happyhooligans.com/robots.txt
Redirect https://happyhooligans.ca/robots.txt
Redirect Domain happyhooligans.ca
Redirect Base happyhooligans.ca
Domain IPs 104.21.92.127, 172.67.193.75, 2606:4700:3030::ac43:c14b, 2606:4700:3032::6815:5c7f
Redirect IPs 158.69.57.77
Response IP 158.69.57.77
Found Yes
Hash 550265bcb0e4893a9060e76a97b5c7d2e76db50c0a999bca3ea99a3fcccb610a
SimHash d905d843e192

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /search/
Disallow /search/*
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://happyhooligans.ca/sitemap_index.xml