AI & Bot Access Documentation
Comprehensive guide for AI systems, research bots, and automated tools to access and consume content from Lyovson.com.
Quick Access
Programmatic Access
- π API Documentation β
- π GraphQL Endpoint β
- πΊοΈ XML Sitemap β
- π€ Robots.txt β
Content Feeds
- π‘ RSS Feed β
- π JSON Feed β
- βοΈ Atom Feed β
- π Search Interface β
AI & Embeddings
- π§ Vector Embeddings β
- π System Status β
- π§ AI Resources β
- β‘ OpenAI Integration
Content Access Methods
1. RSS/JSON/Atom Feeds (Recommended)
For bulk content consumption, use our syndication feeds. They include full article content, metadata, and are updated hourly.
JSON Feed with Enhanced Metadata
GET https://lyovson.com/feed.json
// Returns JSON with full content + AI-friendly metadata:
{
"items": [{
"title": "Article Title",
"content_text": "Full article content...",
"_lyovson_metadata": {
"wordCount": 1200,
"readingTime": 6,
"contentType": "article",
"language": "en",
"projectSlug": "next",
"apiUrl": "https://lyovson.com/api/posts/123"
}
}]
}
2. GraphQL API
For structured queries and real-time data access. Supports filtering, sorting, and relationship traversal.
GraphQL Query Example
POST https://lyovson.com/api/graphql
query LatestPosts {
Posts(limit: 10, sort: "-publishedAt", where: { _status: { equals: "published" } }) {
docs {
title
slug
content
publishedAt
populatedAuthors {
name
username
}
project {
name
slug
}
topics {
name
slug
}
meta {
title
description
}
}
}
}
3. REST API
Standard REST endpoints for all content types. Supports pagination, filtering, and depth control.
REST API Examples
# Get latest posts
GET https://lyovson.com/api/posts?limit=10&sort=-publishedAt&where[_status][equals]=published
# Get all projects with related posts
GET https://lyovson.com/api/projects?depth=1
# Search content
GET https://lyovson.com/api/search?q=programming&limit=20
# Get specific post with full depth
GET https://lyovson.com/api/posts/[id]?depth=2
4. Vector Embeddings API
Get vector embeddings for semantic search, content similarity, and AI applications. Supports both OpenAI embeddings and fallback hash-based vectors.
Embeddings API Examples
# Get embedding for a specific post (pre-computed, ~50ms)
GET https://lyovson.com/api/embeddings/posts/123
# Get embeddings for all posts (bulk access)
GET https://lyovson.com/api/embeddings?type=posts&limit=50
# Get embedding for a text query (real-time generation)
GET https://lyovson.com/api/embeddings?q=programming tutorials
# Get system status and coverage
GET https://lyovson.com/api/embeddings/status
# Response includes:
{
"id": 123,
"embedding": [0.1, -0.2, 0.3, ...], // 1536-dimensional vector
"dimensions": 1536,
"metadata": {
"title": "Post Title",
"url": "https://lyovson.com/project/post-slug",
"wordCount": 1200,
"readingTime": 6,
"topics": ["programming", "javascript"],
"isPrecomputed": true
},
"model": "text-embedding-3-small"
}
π§ Advanced Vector Embeddings System
β‘ High-Performance Pre-computed Embeddings
Our embedding system uses OpenAI's latest text-embedding-3-small model with automatic pre-computation for lightning-fast API responses (<100ms vs 1-3s traditional).
π Performance Features
- β’ Pre-computed vectors - Generated on post publish/update
- β’ 1536-dimensional OpenAI text-embedding-3-small
- β’ Smart regeneration - Only when content changes
- β’ Fallback system - Works without OpenAI API key
- β’ Sub-100ms responses for individual posts
- β’ Bulk access for training and analysis
π§ AI Applications
- β’ Semantic search - Find related content
- β’ Content clustering - Group similar articles
- β’ Recommendation engines - Suggest related posts
- β’ Content analysis - Theme and topic discovery
- β’ Similarity scoring - Measure content relationships
- β’ AI training data - High-quality labeled vectors
π Monitor System Health
Check embedding coverage and system status:
GET https://lyovson.com/api/embeddings/status β
Best Practices for AI Systems
π Performance
- Use feeds for bulk content access (rate limit: 1000/hour)
- Respect Cache-Control headers for optimal performance
- API endpoints have lower rate limits (100/hour)
- Include descriptive User-Agent header identifying your service
π Content Understanding
- All content includes structured metadata (JSON-LD)
- Articles are categorized by project and tagged with topics
- Full-text search available across all content
- Content relationships are explicit (author, project, topics)
π€ Attribution
- Content copyright: Rafa & Jess Lyovson
- Attribution required: "Lyovson.com - https://lyovson.com"
- Contact hello@lyovson.com for licensing questions
- Academic and research use generally permitted with attribution
Structured Data & Metadata
All pages include comprehensive structured data following Schema.org standards:
Schema Types
- π Article (posts)
- π’ Organization (site info)
- π WebSite (global metadata)
- π€ Person (authors)
- π SearchAction (search capability)
Metadata Fields
- π Publication/modification dates
- π Word count & reading time
- π·οΈ Topics and categories
- π₯ Author information
- π Canonical URLs
Article Schema includes:
- Context and type information
- Headline and description
- Publication and modification dates
- Author information with URLs
- Publisher organization data
- Word count and reading time
Contact & Support
Need higher rate limits, custom access, or have questions about using our content?
Last updated: January 16, 2025 β’ Machine-readable version β