universal-db.com
robots.txt

Robots Exclusion Standard data for universal-db.com

Resource Scan

Scan Details

Site Domain universal-db.com
Base Domain universal-db.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-10T15:25:16+00:00
Next Scan 2025-12-24T15:25:16+00:00

Last Successful Scan

Scanned2025-11-01T17:11:44+00:00
URL http://universal-db.com/robots.txt
Domain IPs 38.177.133.41
Response IP 38.177.133.41
Found Yes
Hash b51fdf5fdf5bd1c0b1d4554529f5563259fb42b90a77a0f15baa0026495d08df
SimHash d25fd520fe18

Groups

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /