darivip.com
robots.txt

Robots Exclusion Standard data for darivip.com

Resource Scan

Scan Details

Site Domain darivip.com
Base Domain darivip.com
Scan Status Ok
Last Scan2026-01-31T14:13:49+00:00
Next Scan 2026-03-02T14:13:49+00:00

Last Scan

Scanned2026-01-31T14:13:49+00:00
URL https://darivip.com/robots.txt
Domain IPs 2a03:6f00:1::5c35:60a9, 92.53.96.169
Response IP 92.53.96.169
Found Yes
Hash 7f621e5b1b8f50834809ab1786b82f3f4e002432819b7388d0fe1265277d57e0
SimHash 4848d40257bc

Groups

googlebot

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

yandex

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

bingbot

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 2

*

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.svg
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.ttf
Allow /*.eot
Allow /*.woff
Allow /*.woff2
Allow /*.pdf
Allow /*sitemap*.xml
Allow /*sitemap*.xml.gz
Disallow */bin/
Disallow */cgi-bin/
Disallow /wp-admin/
Disallow /*.php$
Disallow /*.htm*$
Disallow /*.shtml$
Disallow /*.txt$
Disallow /*.log.*$
Disallow /*.sql$
Disallow /author/
Disallow /tag/
Disallow /category/uncategorized/
Disallow */blackhole/
Disallow */feed/
Disallow */embed/
Disallow /search/
Disallow */trackback/
Disallow /*?*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://darivip.com/sitemap_index.xml

Warnings

  • `host` is not a known field.