Log In Sign Up

ba.no
robots.txt

Robots Exclusion Standard data for ba.no

Resource Scan

Scan Details

Site Domain ba.no
Base Domain ba.no
Scan Status Ok
Last Scan2024-05-16T01:49:55+00:00
Next Scan 2024-05-23T01:49:55+00:00

Last Scan

Scanned2024-05-16T01:49:55+00:00
URL https://ba.no/robots.txt
Redirect https://www.ba.no/robots.txt
Redirect Domain www.ba.no
Redirect Base ba.no
Domain IPs 2a02:c0:ac::e51:1, 87.238.38.1, 87.238.38.2
Redirect IPs 104.18.20.60, 104.18.21.60, 2606:4700::6812:143c, 2606:4700::6812:153c
Response IP 104.18.20.60
Found Yes
Hash 722ffcce7840a6654f4155c01b7aa019e1fa9b770c52f3f7604b9c1375a930c7
SimHash 70974087e429

Groups

*

Rule Path
Allow /ads.txt
Disallow /rss/
Disallow /sok/
Disallow /imaker
Disallow /00/
Disallow /01/
Disallow /02/
Disallow /03/
Disallow /04/
Disallow /05/
Disallow /06/
Disallow /07/
Disallow /08/
Disallow /09/
Disallow /10/
Disallow /11/
Disallow /12/
Disallow /13/
Disallow /14/
Disallow /15/
Disallow /16/
Disallow /17/
Disallow /18/
Disallow /19/
Disallow /20/
Disallow /21/
Disallow /22/
Disallow /23/
Disallow /24/
Disallow /25/
Disallow /26/
Disallow /27/
Disallow /28/
Disallow /29/
Disallow /30/
Disallow /31/
Disallow /32/
Disallow /33/
Disallow /34/
Disallow /35/
Disallow /36/
Disallow /37/
Disallow /38/
Disallow /39/
Disallow /40/
Disallow /41/
Disallow /42/
Disallow /43/
Disallow /44/
Disallow /45/
Disallow /46/
Disallow /47/
Disallow /48/
Disallow /49/
Disallow /50/
Disallow /51/
Disallow /52/
Disallow /53/
Disallow /54/
Disallow /55/
Disallow /56/
Disallow /57/
Disallow /58/
Disallow /59/
Disallow /60/
Disallow /61/
Disallow /62/
Disallow /63/
Disallow /64/
Disallow /65/
Disallow /66/
Disallow /67/
Disallow /68/
Disallow /69/
Disallow /70/
Disallow /71/
Disallow /72/
Disallow /73/
Disallow /74/
Disallow /75/
Disallow /76/
Disallow /77/
Disallow /78/
Disallow /79/
Disallow /80/
Disallow /81/
Disallow /82/
Disallow /83/
Disallow /84/
Disallow /85/
Disallow /86/
Disallow /87/
Disallow /88/
Disallow /89/
Disallow /90/
Disallow /91/
Disallow /92/
Disallow /93/
Disallow /94/
Disallow /95/
Disallow /96/
Disallow /97/
Disallow /98/
Disallow /99/
Disallow /vis/rubrikk/*localGeo%3Dfalse*
Disallow /vis/rubrikk/*page%3D*
Disallow /vis/rubrikk/*foreignGeo%3D*
Disallow /vis/rubrikk/*priceTo%3D*
Disallow /vis/rubrikk/*priceFrom%3D*
Disallow /vis/rubrikk/*compId%3D*
Disallow /vis/rubrikk/*condition%3D*
Disallow /vis/rubrikk/*saleType%3D*
Disallow /vis/rubrikk/*type%3D*
Disallow /vis/rubrikk/*monthlyRentTo%3D*
Disallow /vis/rubrikk/*pRoomAreaTo%3D*
Disallow /vis/rubrikk/*bedroomsFrom%3D*
Disallow /vis/rubrikk/*mileageTo%3D*
Disallow /vis/rubrikk/*mileageFrom%3D*
Disallow /vis/rubrikk/*modelYearTo%3D*
Disallow /vis/rubrikk/*modelYearFrom%3D*
Disallow /vis/rubrikk/*fuelType%3D*
Disallow /vis/rubrikk/*gearType%3D*
Disallow /vis/rubrikk/*wheelDrive%3D*
Disallow /vis/rubrikk/*engineHpTo%3D*
Disallow /vis/rubrikk/*engineHpFrom%3D*
Disallow /vis/rubrikk/*seats%3D*
Disallow /vis/rubrikk/*workHours%3D*
Disallow /vis/rubrikk/*workSector%3D*
Disallow /vis/rubrikk/*makeModel%3D*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Back to top

Comments

  • ACAP version=1.0
  • Rubrikk
  • Start AI crawler block
  • End AI crawler block
Back to top

Warnings

  • `acap-crawler` is not a known field.
  • `acap-disallow-crawl` is not a known field.
Back to top