summarum.fi
robots.txt

Robots Exclusion Standard data for summarum.fi

Resource Scan

Scan Details

Site Domain summarum.fi
Base Domain summarum.fi
Scan Status Ok
Last Scan2024-05-22T04:03:57+00:00
Next Scan 2024-05-29T04:03:57+00:00

Last Scan

Scanned2024-05-22T04:03:57+00:00
URL https://summarum.fi/robots.txt
Redirect https://www.summarum.fi/robots.txt
Redirect Domain www.summarum.fi
Redirect Base summarum.fi
Domain IPs 104.26.2.32, 104.26.3.32, 172.67.71.189, 2606:4700:20::681a:220, 2606:4700:20::681a:320, 2606:4700:20::ac43:47bd
Redirect IPs 104.26.2.32, 104.26.3.32, 172.67.71.189, 2606:4700:20::681a:220, 2606:4700:20::681a:320, 2606:4700:20::ac43:47bd
Response IP 172.67.71.189
Found Yes
Hash 631fc36107c37b2bd64bec93ea99b50a7b08c28d8edc879c1a881b2e2d4ffb3e
SimHash e87c59ed8033

Groups

*

Rule Path
Disallow /wp-content/uploads/wpo-plugins-tables-list.json
Disallow /?s=
Disallow *%26s%3D
Disallow /*?s=
Disallow /*?q=
Disallow /*?rss
Disallow /page/*/?s=
Disallow /search/
Disallow /feed/
Allow /feed/$
Disallow /comments/feed/
Disallow /*/attachment/
Disallow /?attachment_id*
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /license.txt
Disallow /cgi-bin/
Disallow /*?fbclid=
Disallow /*?source=
Disallow /*?ref*
Disallow /*?page_id=
Disallow /*.pdf$
Disallow /*/1000$
Disallow /ota/*
Disallow /us/*
Disallow /jatkoa/*
Disallow /ehdotus/*

facebookexternalhit

Rule Path
Allow /*?fbclid=

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

spawning-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.summarum.fi/sitemap_index.xml
sitemap https://www.summarum.fi/page-sitemap.xml