restaurantfuttatinni.com
robots.txt

Robots Exclusion Standard data for restaurantfuttatinni.com

Resource Scan

Scan Details

Site Domain restaurantfuttatinni.com
Base Domain restaurantfuttatinni.com
Scan Status Ok
Last Scan2026-02-05T14:02:33+00:00
Next Scan 2026-03-07T14:02:33+00:00

Last Scan

Scanned2026-02-05T14:02:33+00:00
URL https://restaurantfuttatinni.com/robots.txt
Domain IPs 2a02:4780:84:4d01:7a22:45f2:6d6f:d6a6, 2a02:4780:84:6676:29e3:d7ec:e0ed:4f69, 84.32.84.153, 84.32.84.154
Response IP 93.127.201.62
Found Yes
Hash 076e9112eb923515cc16c287128aae35422550665b78e34d607cf9a4cf6acb95
SimHash 61165f70f6f9

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /cgi-bin/
Disallow /includes/
Disallow /tmp/
Disallow /private/
Disallow /config/
Disallow /backup/
Disallow /logs/
Disallow /phpmyadmin/
Disallow /*.php$
Disallow /*.inc$
Disallow /*.sql$
Disallow /*.gz$
Disallow /*.zip$
Disallow /*.tar$
Disallow /*?*
Disallow /*%26*
Disallow /search/
Disallow /tag/
Disallow /author/
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.webp$
Allow /*.svg$
Allow /*.ico$
Allow /*.woff$
Allow /*.woff2$
Allow /*.ttf$
Allow /*.eot$

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /
Disallow /private/

Other Records

Field Value
crawl-delay 0.5

googlebot-image

Rule Path
Allow /images/
Allow /uploads/
Allow /assets/
Disallow /private-images/

bingbot

Rule Path
Allow /
Disallow /private/

Other Records

Field Value
crawl-delay 1

yandexbot

Rule Path
Allow /
Disallow /private/

Other Records

Field Value
crawl-delay 2

baiduspider

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

twitterbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

pinterest

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

linkedinbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://restaurantfuttatinni.com/sitemap.xml
sitemap https://restaurantfuttatinni.com/sitemap-index.xml
sitemap https://restaurantfuttatinni.com/sitemap-pages.xml
sitemap https://restaurantfuttatinni.com/sitemap-images.xml
sitemap https://restaurantfuttatinni.com/sitemap-videos.xml

Comments

  • robots.txt untuk SLOTO69 Restaurant (restaurantfuttatinni.com)
  • Generated: 2024-01-15
  • Contact: info@restaurantfuttatinni.com
  • ALLOW penting untuk SEO
  • Sitemap
  • Crawl delay (opsional)
  • Specific bots
  • Media bots
  • Scrapers to block
  • Host

Warnings

  • `host` is not a known field.