LinerBot is actually the web crawler for LINER (getliner.com), an AI-powered workspace and search tool that helps users highlight, annotate, and discover web content. It crawls to index pages for LINER’s AI search engine.
LinerBot
What is LinerBot?
Why is LinerBot crawling my site?
LinerBot crawls websites to gather and index content for LINER’s AI search engine. When a user asks a question in LINER, the bot has previously crawled the web to find the most relevant sources to surface as answers. It is not a search engine crawler (like Googlebot) and blocking it will not affect your search engine rankings.
You may want to block it if you are concerned about:
- Your content being used to train or fine-tune AI models
- Competitive intelligence or data aggregation
- Unwanted server load from automated crawling
Threat research insights on LinerBot
All data in this section are produced by DataDome's Galileo Threat Research team from our proprietary detection network and reviewed by human analysts.
Verified Bot
A verified bot has high identification strength
Not verified
Robots.txt Compliance
Whether this bot respects robots.txt directives
Respected
Identification Strength
How confidently DataDome can identify this bot
Low
Traffic origins
Top 15 countries by bot traffic
US
67.05%
SA
32.95%
Most used autonomous system (AS)
Top 5 by traffic share
Google LLC
95.45%
Oracle Corporation
4.55%
Traffic Occupancy
<0.1%
On average, occupy <0.1% of the traffic from bots in the directory
Authorization Rate
0%
Businesses decide to authorize this bot 0% of the time
How to block LinerBot?
1. Robots.txt File
Add the following rule to your robots.txt file:
User-agent: LinerBot Disallow: /
You can also allow selective access:
User-agent: LinerBot Allow: /public/ Disallow: /private/
2. Firewall Rules: Block requests based on the user-agent string LinerBot or by IP address ranges. LINER publishes its current IP pool at: https://docs.getliner.com/linerbot.json (note: IP ranges may change over time).
3. .htaccess File: Use Apache’s .htaccess file to deny access based on the user-agent string. This method is effective for Apache servers.
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} LinerBot [NC]
RewriteRule .* - [F,L]
4. Web Application Firewall (WAF): Configure your WAF to detect and block requests matching the LinerBot user-agent string.
5. Server-Side Scripting: You can block LinerBot directly at the application level by checking the user-agent string in your server-side code and returning a 403 Forbidden response.
6. Rate Limiting: If you prefer not to fully block LinerBot but want to limit its impact on your server, you can configure rate limiting rules targeting the LinerBot user-agent. This allows you to throttle the number of requests it can make within a given time window, reducing server load while still allowing partial access to your content.
TRY FREE
See which bots and AI agents bypass your defenses
Create your account to start analyzing and mitigating malicious bots and AI-drive threats in real-time