xcritical.com
robots.txt

Robots Exclusion Standard data for xcritical.com

Resource Scan

Scan Details

Site Domain xcritical.com
Base Domain xcritical.com
Scan Status Ok
Last Scan2024-05-31T13:28:01+00:00
Next Scan 2024-06-30T13:28:01+00:00

Last Scan

Scanned2024-05-31T13:28:01+00:00
URL https://xcritical.com/robots.txt
Redirect https://www.xcritical.com/robots.txt
Redirect Domain www.xcritical.com
Redirect Base xcritical.com
Domain IPs 3.64.200.42, 3.66.140.36
Redirect IPs 108.156.133.107, 108.156.133.49, 108.156.133.85, 108.156.133.99
Response IP 108.156.133.49
Found Yes
Hash f9a7bd49e46cab477ba7ae071152a6cb7e725bdb6a5e5ed8784bfa8c726bab7d
SimHash 6804e3542b35

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-*
Disallow /*?*
Allow */uploads
Allow /images
Allow /wp-*/*.js
Allow /wp-*/*.css
Allow /wp-*/*.jpg
Allow /wp-*/*.png
Allow /wp-*/*.svg
Allow /wp-*/*.ttf
Allow /wp-*/*.gif
Allow /wp-*/*.webp

Other Records

Field Value
sitemap https://www.xcritical.com/sitemap_index.xml