iphoned.nl
robots.txt

Robots Exclusion Standard data for iphoned.nl

Resource Scan

Scan Details

Site Domain iphoned.nl
Base Domain iphoned.nl
Scan Status Ok
Last Scan2024-06-02T01:15:09+00:00
Next Scan 2024-06-09T01:15:09+00:00

Last Scan

Scanned2024-06-02T01:15:09+00:00
URL https://iphoned.nl/robots.txt
Redirect https://www.iphoned.nl/robots.txt
Redirect Domain www.iphoned.nl
Redirect Base iphoned.nl
Domain IPs 104.26.8.15, 104.26.9.15, 172.67.69.131, 2606:4700:20::681a:80f, 2606:4700:20::681a:90f, 2606:4700:20::ac43:4583
Redirect IPs 104.26.8.15, 104.26.9.15, 172.67.69.131, 2606:4700:20::681a:80f, 2606:4700:20::681a:90f, 2606:4700:20::ac43:4583
Response IP 104.26.8.15
Found Yes
Hash 60bdff8d311fbc1ac29a5ef3d8676aff7e65772916516943450a72cb41d9fbd6
SimHash 109ad931c543

Groups

*

Rule Path
Disallow /api/*
Allow /app/$
Disallow /app/*
Disallow /naar-winkel/
Disallow /naar-shop/
Disallow /out/
Disallow /pagina/
Disallow /search/
Disallow /top-apps/
Disallow /wp/wp-admin/
Disallow /auteur/*/archief/
Disallow /thema/*/archief/
Allow /apps/nieuws/archief/
Disallow /*/*/nieuws/archief/
Allow /videos/tips/archief/
Disallow /*/*/tips/archief/
Disallow /?key=*
Disallow */?s=
Disallow /wp-content/themes/bigspark/ajax/dynamic-content.php
Disallow /*/pagina/*/?*
Disallow /wp-content/themes/bigspark/ajax/device-url.php
Disallow /apple/*/nieuws/
Disallow /apple/*/tips/
Disallow /wp-json/
Disallow /?rest_route=
Disallow */?categorieen=
Disallow */?type=
Disallow */?themas=
Disallow */?productcategorieen=
Disallow */?merk=
Disallow */?product=

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

eknip

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.iphoned.nl/sitemap_index.xml
sitemap https://www.iphoned.nl/google-news-sitemap.xml
sitemap https://www.iphoned.nl/advisor-sitemap.php

Comments

  • General directives
  • Ban AI bots
  • Ban other bots

Warnings

  • 2 invalid lines.