huler1996.com
robots.txt

Robots Exclusion Standard data for huler1996.com

Resource Scan

Scan Details

Site Domain huler1996.com
Base Domain huler1996.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-05-22T15:09:15+00:00
Next Scan 2024-07-21T15:09:15+00:00

Last Successful Scan

Scanned2024-03-24T12:22:37+00:00
URL https://huler1996.com/robots.txt
Domain IPs 104.21.44.121, 172.67.199.149, 2606:4700:3031::6815:2c79, 2606:4700:3037::ac43:c795
Response IP 104.21.44.121
Found Yes
Hash 8328d6cfa93735e2b9afa149eaf60a8961fce303bcdcea8f3a30803f7dfa8089
SimHash 69519985e1d2

Groups

*

Rule Path
Disallow /types-of-aalcff

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /vev1w

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /kzu6o

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /discount-furniture-hypa

bingbot
googlebot
slurp

Rule Path
Disallow

*

Rule Path
Disallow /lady-s-cwcj

bingbot
googlebot
slurp

Rule Path
Disallow

Other Records

Field Value
sitemap https://huler1996.com/types-of-aalcff/sitemap.xml
sitemap https://huler1996.com/vev1w/sitemap.xml
sitemap https://huler1996.com/kzu6o/sitemap.xml
sitemap https://huler1996.com/discount-furniture-hypa/sitemap.xml
sitemap https://huler1996.com/lady-s-cwcj/sitemap.xml