datametica.com
robots.txt

Robots Exclusion Standard data for datametica.com

Resource Scan

Scan Details

Site Domain datametica.com
Base Domain datametica.com
Scan Status Ok
Last Scan2025-09-19T04:24:49+00:00
Next Scan 2025-10-19T04:24:49+00:00

Last Scan

Scanned2025-09-19T04:24:49+00:00
URL https://datametica.com/robots.txt
Domain IPs 104.21.91.254, 172.67.183.110, 2606:4700:3030::6815:5bfe, 2606:4700:3031::ac43:b76e
Response IP 104.21.91.254
Found Yes
Hash a04dd6a95dcfc570eac60f2eb9ec9bca4b9ab93cab7e598c2327195d7dcb159d
SimHash 4188f2440fa6

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /staging/
Allow /wp-admin/admin-ajax.php

freefind

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

jetbot/1.0

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

webzip

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

netants

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

webauto

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.datametica.com/sitemap.xml