berliner-jobmarkt.de
robots.txt

Robots Exclusion Standard data for berliner-jobmarkt.de

Resource Scan

Scan Details

Site Domain berliner-jobmarkt.de
Base Domain berliner-jobmarkt.de
Scan Status Ok
Last Scan2024-09-29T19:28:36+00:00
Next Scan 2024-10-06T19:28:36+00:00

Last Scan

Scanned2024-09-29T19:28:36+00:00
URL https://berliner-jobmarkt.de/robots.txt
Redirect https://www.berliner-jobmarkt.de/robots.txt
Redirect Domain www.berliner-jobmarkt.de
Redirect Base berliner-jobmarkt.de
Domain IPs 20.113.33.149
Redirect IPs 20.113.33.149
Response IP 20.113.33.149
Found Yes
Hash 36b2efd5f836c235bc61c7924ccdc0186e07b374774bc4d4aec4db8dfe408465
SimHash 235418858d92

Groups

*

Rule Path
Disallow /feed/all
Disallow /feed/portal

Other Records

Field Value
sitemap https://www.berliner-jobmarkt.de/sitemap.xml
sitemap https://www.berliner-jobmarkt.de/CompaniesProfilesSiteMap.xml

Comments

  • no robots