Log In Sign Up

shadowing.ai
robots.txt

Robots Exclusion Standard data for shadowing.ai

Resource Scan

Scan Details

Site Domain shadowing.ai
Base Domain shadowing.ai
Scan Status Ok
Last Scan2024-06-12T10:14:52+00:00
Next Scan 2024-07-12T10:14:52+00:00

Last Scan

Scanned2024-06-12T10:14:52+00:00
URL https://shadowing.ai/robots.txt
Domain IPs 104.18.4.56, 104.18.5.56, 2606:4700::6812:438, 2606:4700::6812:538
Response IP 104.18.5.56
Found Yes
Hash ef80c1fb98dd5b73848376073669e41bccfc3dd14daeff8c345a583bb1e290b1
SimHash 416c44e8aa91

Groups

*

Rule Path
Disallow */index.html
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 30
Back to top

Other Records

Field Value
sitemap https://shadowing.ai/sitemap.xml
sitemap https://shadowing.ai/sitemap-faq.xml
sitemap https://shadowing.ai/sitemap-mirror_room_category-0-45000.xml
sitemap https://shadowing.ai/sitemap-mirror-questions-07-11-2023-5.xml
sitemap https://shadowing.ai/sitemap-mirror-questions-07-11-2023-4.xml
sitemap https://shadowing.ai/sitemap-mirror-questions-07-11-2023-3.xml
sitemap https://shadowing.ai/sitemap-mirror-questions-07-11-2023-2.xml
sitemap https://shadowing.ai/sitemap-companies-0-11000.xml
sitemap https://shadowing.ai/sitemap-companies-12084-11000.xml
sitemap https://shadowing.ai/sitemap-companies-26880-11000.xml
sitemap https://shadowing.ai/sitemap-companies-38805-11000.xml
sitemap https://shadowing.ai/sitemap-companies-61462-11000.xml
sitemap https://shadowing.ai/sitemap-companies-73554-11000.xml
sitemap https://shadowing.ai/sitemap-companies-85647-11000.xml
sitemap https://shadowing.ai/sitemap-companies-97696-11000.xml
sitemap https://shadowing.ai/sitemap-companies-109670-11000.xml
sitemap https://shadowing.ai/sitemap-companies-121690-11000.xml
sitemap https://shadowing.ai/sitemap-companies-133656-11000.xml
sitemap https://shadowing.ai/sitemap-companies-145611-11000.xml
sitemap https://shadowing.ai/sitemap-companies-157588-11000.xml
sitemap https://shadowing.ai/sitemap-companies-169566-11000.xml
sitemap https://shadowing.ai/sitemap-companies-1031084-11000.xml
sitemap https://shadowing.ai/sitemap-companies-1036152-11000.xml
sitemap https://shadowing.ai/sitemap-hiring-0-48000.xml
Back to top