bezahlen.net
robots.txt

Robots Exclusion Standard data for bezahlen.net

Resource Scan

Scan Details

Site Domain bezahlen.net
Base Domain bezahlen.net
Scan Status Ok
Last Scan2024-10-04T16:03:36+00:00
Next Scan 2024-10-11T16:03:36+00:00

Last Scan

Scanned2024-10-04T16:03:36+00:00
URL https://bezahlen.net/robots.txt
Domain IPs 2a00:1169:103:9670::, 92.205.52.152
Response IP 92.205.52.152
Found Yes
Hash d947be7028dda6bdaa53a9403ba206b77943e0c04842ab248fae1c3e740f8689
SimHash 821d8a919b02

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /goto/
Disallow /wp-content/cache/cachify/
Disallow /wp-content/cache/wp-rocket/
Disallow /redirect/
Disallow /shop/eigenschaft/
Disallow /rechnungskauf/page/
Disallow /ratenzahlung/page/
Disallow *page_id%3D24009*
Disallow /shop/

strucr
mj12bot
ahrefsbot
seokicks-robot
xovi
searchmetricsbot
backlinkcrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bezahlen.net/ratgeber-sitemap.xml
sitemap https://www.bezahlen.net/ratenzahlung-sitemap.xml
sitemap https://www.bezahlen.net/rechnungskauf-sitemap.xml
sitemap https://www.bezahlen.net/page-sitemap.xml
sitemap https://www.bezahlen.net/post-sitemap.xml
sitemap https://www.bezahlen.net/ratgeber-sitemap2.xml
sitemap https://www.bezahlen.net/ratgeber-sitemap3.xml