xquissive.com
robots.txt

Robots Exclusion Standard data for xquissive.com

Resource Scan

Scan Details

Site Domain xquissive.com
Base Domain xquissive.com
Scan Status Ok
Last Scan2024-11-15T20:35:22+00:00
Next Scan 2024-11-22T20:35:22+00:00

Last Scan

Scanned2024-11-15T20:35:22+00:00
URL https://www.xquissive.com/robots.txt
Domain IPs 209.38.34.8
Response IP 209.38.34.8
Found Yes
Hash 396fe7dbd0452f9d4fd88adb98fba7659d5fac9d42ff10afadccbbb40e54c18d
SimHash 5a6edccae21a

Groups

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/uploads/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-config.php
Disallow /?s=
Disallow /search/
Disallow /category/
Disallow /tag/
Disallow /author/
Disallow /archives/
Disallow /*?*

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

hypefactors.com

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Comments

  • Block specific bots