mujtahid.net
robots.txt

Robots Exclusion Standard data for mujtahid.net

Resource Scan

Scan Details

Site Domain mujtahid.net
Base Domain mujtahid.net
Scan Status Ok
Last Scan2024-09-23T21:35:56+00:00
Next Scan 2024-09-30T21:35:56+00:00

Last Scan

Scanned2024-09-23T21:35:56+00:00
URL https://mujtahid.net/robots.txt
Domain IPs 104.21.85.37, 172.67.201.228, 2606:4700:3030::6815:5525, 2606:4700:3036::ac43:c9e4
Response IP 104.21.85.37
Found Yes
Hash a113d2f95b5583cc6d216a9d3eb9bf63203865a70976cbce1514abdc426ed953
SimHash 21055011c715

Groups

bingbot

Rule Path
Disallow /wp-admin

googlebot

Rule Path
Disallow /wp-admin

petalbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /wp-admin

twitterbot
msnbot

Rule Path
Disallow /wp-admin

ia_archiver

Rule Path
Allow /index.php

*

Rule Path
Disallow /wp-admin

Other Records

Field Value
sitemap https://mujtahid.net/sitemap.xml