Log In Sign Up

universocdmx.com
robots.txt

Robots Exclusion Standard data for universocdmx.com

Resource Scan

Scan Details

Site Domain universocdmx.com
Base Domain universocdmx.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan4/5/2025, 6:58:38 AM
Next Scan 4/12/2025, 6:58:38 AM

Last Successful Scan

Scanned3/28/2025, 6:58:19 AM
URL https://universocdmx.com/robots.txt
Domain IPs 198.59.144.195
Response IP 198.59.144.195
Found Yes
Hash 49570880bba1bafac4249e550b5c71d3f8f0161ca0ac0a8f864377001c50bd6b
SimHash 4d1dd7b07780

Groups

googlebot

Rule Path
Disallow /*.gif$

googlebot

Rule Path
Disallow /*.PDF$

googlebot

Rule Path
Disallow /*?*products=
Disallow /*?*color=
Disallow /*?*size=
Allow /*?products=all$

googlebot-news

Rule Path
Allow /
Disallow /cart
Disallow /search
Disallow /calendar

*

Rule Path
Disallow /cart

examplebot
otherbot

Rule Path
Disallow /search
Disallow /calendar
Disallow /cart

aicorp-trainer-bot

Rule Path
Disallow /
Allow /$
Back to top

Other Records

Field Value
sitemap https://universocdmx.com/feed/gn
sitemap https://universocdmx.com/sitemap_index.xml
Back to top

Warnings

  • 1 invalid line.
Back to top