Log In Sign Up

quick-cargo-service.com
robots.txt

Robots Exclusion Standard data for quick-cargo-service.com

Resource Scan

Scan Details

Site Domain quick-cargo-service.com
Base Domain quick-cargo-service.com
Scan Status Ok
Last Scan2026-01-18T18:18:52+00:00
Next Scan 2026-01-25T18:18:52+00:00

Last Scan

Scanned2026-01-18T18:18:52+00:00
URL https://quick-cargo-service.com/robots.txt
Domain IPs 185.237.67.35
Response IP 185.237.67.35
Found Yes
Hash 71e24c09ba59f21cbb4f3a35469d4c5f502b0c442340a7dd44fa664bb890ef8b
SimHash 404d1cb086a2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-includes
Disallow /wp-content/cache
Disallow /trackback
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Allow /

barkrowler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

neticle

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

adstxtcrawlertp

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://quick-cargo-service.com/page-sitemap.xml
sitemap https://quick-cargo-service.com/post-sitemap.xml
sitemap https://quick-cargo-service.com/jobpost-sitemap.xml
Back to top

Comments

  • babbar.tech/crawler
  • babbar.tech/crawler
  • brandwatch.net
  • brandwatch.net
  • opensiteexplorer.org/dotbot
  • moz.com/help/moz-procedures/crawlers/rogerbot
  • ahrefs.com
  • semrush.com
  • webmaster.petalsearch.com/site/petalbot
  • majestic.com
  • yandex.com
  • yandex.com
  • dataforseo.com/dataforseo-bot
  • help.coccoc.com/search-engine
  • mojeek.com/bot.html
  • bot.neticle.hu
  • webmeup-crawler.com
  • AdsTxtCrawlerTP
  • ________ ________ ________
  • |\ __ \|\ ____\|\ ____\
  • \ \ \|\ \ \ \___|\ \ \___|_
  • \ \ \\\ \ \ \ \ \_____ \
  • \ \ \\\ \ \ \____\|____|\ \
  • \ \_____ \ \_______\____\_\ \
  • \|___| \__\|_______|\_________\
  • \|__| \|_________|
Back to top