cubis2.us
robots.txt

Robots Exclusion Standard data for cubis2.us

Resource Scan

Scan Details

Site Domain cubis2.us
Base Domain cubis2.us
Scan Status Ok
Last Scan2024-06-10T21:18:39+00:00
Next Scan 2024-06-17T21:18:39+00:00

Last Scan

Scanned2024-06-10T21:18:39+00:00
URL https://cubis2.us/robots.txt
Domain IPs 104.21.34.211, 172.67.165.146, 2606:4700:3032::ac43:a592, 2606:4700:3034::6815:22d3
Response IP 104.21.34.211
Found Yes
Hash 39b66cbf22a1b913e9a5a56fcddff0b4253479d06b61444f4af5b56b95376876
SimHash ea098a02cbb2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/

Other Records

Field Value
sitemap https://cubis2.us/sitemap.rss
sitemap https://cubis2.us/sitemap.xml