saamana.com
robots.txt

Robots Exclusion Standard data for saamana.com

Resource Scan

Scan Details

Site Domain saamana.com
Base Domain saamana.com
Scan Status Ok
Last Scan2024-06-14T06:47:54+00:00
Next Scan 2024-06-21T06:47:54+00:00

Last Scan

Scanned2024-06-14T06:47:54+00:00
URL https://saamana.com/robots.txt
Domain IPs 104.21.72.228, 172.67.136.94, 2606:4700:3031::6815:48e4, 2606:4700:3033::ac43:885e
Response IP 172.67.136.94
Found Yes
Hash 637608d9e446057b7fefada03953eecea5e49cf0487d069bee6bdac34459ae37
SimHash 211cc86523b9

Groups

*

Rule Path
Allow /?display=wide
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /readme.html
Disallow /refer/

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow /

crawl

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /