tender-service.com
robots.txt

Robots Exclusion Standard data for tender-service.com

Resource Scan

Scan Details

Site Domain tender-service.com
Base Domain tender-service.com
Scan Status Ok
Last Scan2024-09-15T08:42:55+00:00
Next Scan 2024-10-15T08:42:55+00:00

Last Scan

Scanned2024-09-15T08:42:55+00:00
URL https://tender-service.com/robots.txt
Redirect https://www.tender-service.com/robots.txt
Redirect Domain www.tender-service.com
Redirect Base tender-service.com
Domain IPs 212.232.31.66
Redirect IPs 212.232.31.70
Response IP 212.232.31.70
Found Yes
Hash 78ea3819b8e96636cc0b86ddea79406ab640a039e3dc47ae609428b59b34963f
SimHash 4e1ee0506890

Groups

*

Rule Path
Disallow /api/

dotbot
mj12bot
bubing
semrushbot
semrushbot-sa
megaindex.ru
megaindex.com
ahrefsbot
qwantify
yandexbot
domaincrawler
mappydata.net
alphabot
zoominfobot
istellabot
seokicks
blexbot
serpstatbot
job roboter spider
cliqzbot
baiduspider
mediatoolkitbot
ccbot
adscanner
barkrowler
omgilibot
omgili
buck
hexometer
petalbot
cyberscan.io
gptbot
*

Rule Path
Disallow /

googlebot
bingbot
msnbot

Rule Path
Disallow /api/
Disallow /html2pdf
Allow /

bingbot
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.tender-service.com/sitemap.xml