auxxxreviews.com
robots.txt

Robots Exclusion Standard data for auxxxreviews.com

Resource Scan

Scan Details

Site Domain auxxxreviews.com
Base Domain auxxxreviews.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-11T23:50:14+00:00
Next Scan 2025-03-25T23:50:14+00:00

Last Successful Scan

Scanned2025-02-01T23:49:41+00:00
URL https://auxxxreviews.com/robots.txt
Domain IPs 104.21.83.21, 172.67.167.83, 2606:4700:3030::6815:5315, 2606:4700:3031::ac43:a753
Response IP 104.21.83.21
Found Yes
Hash 95f015bb3df642e5bea6b2f66db9611c2ccc053a205d9c322ab8a79351fd6000
SimHash 855492172952

Groups

*

Rule Path
Allow /
Disallow /forum/admincp/
Disallow /forum/clientscript/
Disallow /forum/cpstyles/
Disallow /forum/customavatars/
Disallow /forum/customprofilepics/
Disallow /forum/images/
Disallow /forum/modcp/
Disallow /forum/ajax.php
Disallow /forum/attachment.php
Disallow /forum/calendar.php
Disallow /forum/cron.php
Disallow /forum/editpost.php
Disallow /forum/global.php
Disallow /forum/image.php
Disallow /forum/inlinemod.php
Disallow /forum/joinrequests.php
Disallow /forum/login.php
Disallow /forum/member.php
Disallow /forum/memberlist.php
Disallow /forum/misc.php
Disallow /forum/moderator.php
Disallow /forum/newattachment.php
Disallow /forum/newreply.php
Disallow /forum/newthread.php
Disallow /forum/online.php
Disallow /forum/poll.php
Disallow /forum/postings.php
Disallow /forum/printthread.php
Disallow /forum/private.php
Disallow /forum/profile.php
Disallow /forum/register.php
Disallow /forum/report.php
Disallow /forum/reputation.php
Disallow /forum/search.php
Disallow /forum/sendmessage.php
Disallow /forum/showgroups.php
Disallow /forum/subscription.php
Disallow /forum/threadrate.php
Disallow /forum/usercp.php
Disallow /forum/usernote.php

*

Rule Path
Disallow /peters/

*

Rule Path
Disallow /adminxxx/

googlebot-image

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /