qualsevolnit.com
robots.txt

Robots Exclusion Standard data for qualsevolnit.com

Resource Scan

Scan Details

Site Domain qualsevolnit.com
Base Domain qualsevolnit.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-05T12:15:56+00:00
Next Scan 2024-12-04T12:15:56+00:00

Last Successful Scan

Scanned2023-08-13T12:08:23+00:00
URL https://qualsevolnit.com/robots.txt
Domain IPs 185.66.41.236
Response IP 185.66.41.236
Found Yes
Hash d996f2343f753d1d6acfe60aa4a20c328f47a04a01542941e66e3100beffad11
SimHash ec104c16d3bc

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-content/
Disallow /wp-icludes/
Disallow /trackback/
Disallow /wp-admin/
Disallow /archives/
Disallow /category/
Disallow /tag/*
Disallow /tag/
Disallow /wp-*
Disallow /login/
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.php$

Other Records

Field Value
crawl-delay 60

all

Rule Path
Allow /

googlebot-image

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.qualsevolnit.com/sitemap-1.xml