iran-tejarat.com
robots.txt

Robots Exclusion Standard data for iran-tejarat.com

Resource Scan

Scan Details

Site Domain iran-tejarat.com
Base Domain iran-tejarat.com
Scan Status Ok
Last Scan2024-09-23T01:11:42+00:00
Next Scan 2024-10-23T01:11:42+00:00

Last Scan

Scanned2024-09-23T01:11:42+00:00
URL https://iran-tejarat.com/robots.txt
Domain IPs 46.102.139.74
Response IP 46.102.139.74
Found Yes
Hash a5a8cfd0e5cad3af9ce7fc38681b8549ab8f85c7f6ded7a396fc9894ae3100ab
SimHash 404f500066b2

Groups

*

Rule Path
Disallow /WebSite/*
Disallow /News/*
Disallow /ItNews/*
Disallow /othersnews/*
Disallow /TechnologyNews/*
Disallow /VehicleNews/*
Disallow /archivedata/*
Disallow /WebSites19/*
Allow /

megaindex.com

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /