al-mstba.com
robots.txt

Robots Exclusion Standard data for al-mstba.com

Resource Scan

Scan Details

Site Domain al-mstba.com
Base Domain al-mstba.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-27T05:35:10+00:00
Next Scan 2025-07-11T05:35:10+00:00

Last Successful Scan

Scanned2025-06-12T02:29:40+00:00
URL https://www.al-mstba.com/robots.txt
Domain IPs 104.21.37.202, 172.67.212.228, 2606:4700:3033::ac43:d4e4, 2606:4700:3035::6815:25ca
Response IP 172.67.212.228
Found Yes
Hash 3f4364dbbf35b14febffe85352321d2f3c08517bec965b3ffa9b6c0b7bbc5d9d
SimHash 5170cfe71033

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /signaturepics/
Disallow /modcp/
Disallow /includes/
Disallow /images/
Disallow /customprofilepics/
Disallow /customgroupicons/
Disallow /customavatars/
Disallow /cpstyles/
Disallow /clientscript/
Disallow /admincp/
Disallow /vbseo/
Disallow calendar.php
Disallow ajax.php
Disallow global.php
Disallow poll.php
Disallow announcement.php
Disallow cron.php
Disallow editpost.php
Disallow joinrequests.php
Disallow login.php
Disallow moderator.php
Disallow newreply.php
Disallow newthread.php
Disallow online.php
Disallow private.php
Disallow profile.php
Disallow postings.php
Disallow printthread.php
Disallow report.php
Disallow register.php
Disallow search.php
Disallow sendmessage.php
Disallow showgroups.php
Disallow showpost.php
Disallow subscription.php
Disallow subscriptions.php
Disallow threadrate.php
Disallow usercp.php
Disallow payments.php
Disallow memberlist.php
Disallow member.php
Disallow image.php
Disallow usernote.php
Disallow visitormessage.php

all

Rule Path
Allow /

googlebot

Rule Path
Allow /*

googlebot-image

Rule Path
Allow /*

mediapartners-google

Rule Path
Allow /*

googlebot-mobile

Rule Path
Allow /*

googlebot-video

Rule Path
Allow /*

googlebot-news

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

Other Records

Field Value
sitemap https://vb.almstbah.com/sitemap_index.xml.gz