AI & Bot Access Documentation

Comprehensive guide for AI systems, research bots, and automated tools to access and consume content from Lyovson.com.

Quick Access

Programmatic Access

Content Feeds

AI & Embeddings

Content Access Methods

1. RSS/JSON/Atom Feeds (Recommended)

For bulk content consumption, use our syndication feeds. They include full article content, metadata, and are updated hourly.

JSON Feed with Enhanced Metadata

GET https://lyovson.com/feed.json

// Returns JSON with full content + AI-friendly metadata:
{
  "items": [{
    "title": "Article Title",
    "content_text": "Full article content...",
    "_lyovson_metadata": {
      "wordCount": 1200,
      "readingTime": 6,
      "contentType": "article",
      "language": "en",
      "projectSlug": "next",
      "apiUrl": "https://lyovson.com/api/posts/123"
    }
  }]
}

2. GraphQL API

For structured queries and real-time data access. Supports filtering, sorting, and relationship traversal.

GraphQL Query Example

POST https://lyovson.com/api/graphql

query LatestPosts {
  Posts(limit: 10, sort: "-publishedAt", where: { _status: { equals: "published" } }) {
    docs {
      title
      slug
      content
      publishedAt
      populatedAuthors {
        name
        username
      }
      project {
        name
        slug
      }
      topics {
        name
        slug
      }
      meta {
        title
        description
      }
    }
  }
}

3. REST API

Standard REST endpoints for all content types. Supports pagination, filtering, and depth control.

REST API Examples

# Get latest posts
GET https://lyovson.com/api/posts?limit=10&sort=-publishedAt&where[_status][equals]=published

# Get all projects with related posts
GET https://lyovson.com/api/projects?depth=1

# Search content
GET https://lyovson.com/api/search?q=programming&limit=20

# Get specific post with full depth
GET https://lyovson.com/api/posts/[id]?depth=2

4. Vector Embeddings API

Get vector embeddings for semantic search, content similarity, and AI applications. Supports both OpenAI embeddings and fallback hash-based vectors.

Embeddings API Examples

# Get embedding for a specific post (pre-computed, ~50ms)
GET https://lyovson.com/api/embeddings/posts/123

# Get embeddings for all posts (bulk access)
GET https://lyovson.com/api/embeddings?type=posts&limit=50

# Get embedding for a text query (real-time generation)
GET https://lyovson.com/api/embeddings?q=programming tutorials

# Get system status and coverage
GET https://lyovson.com/api/embeddings/status

# Response includes:
{
  "id": 123,
  "embedding": [0.1, -0.2, 0.3, ...], // 1536-dimensional vector
  "dimensions": 1536,
  "metadata": {
    "title": "Post Title",
    "url": "https://lyovson.com/project/post-slug",
    "wordCount": 1200,
    "readingTime": 6,
    "topics": ["programming", "javascript"],
    "isPrecomputed": true
  },
  "model": "text-embedding-3-small"
}

🧠 Advanced Vector Embeddings System

⚑ High-Performance Pre-computed Embeddings

Our embedding system uses OpenAI's latest text-embedding-3-small model with automatic pre-computation for lightning-fast API responses (<100ms vs 1-3s traditional).

πŸš€ Performance Features

  • β€’ Pre-computed vectors - Generated on post publish/update
  • β€’ 1536-dimensional OpenAI text-embedding-3-small
  • β€’ Smart regeneration - Only when content changes
  • β€’ Fallback system - Works without OpenAI API key
  • β€’ Sub-100ms responses for individual posts
  • β€’ Bulk access for training and analysis

πŸ”§ AI Applications

  • β€’ Semantic search - Find related content
  • β€’ Content clustering - Group similar articles
  • β€’ Recommendation engines - Suggest related posts
  • β€’ Content analysis - Theme and topic discovery
  • β€’ Similarity scoring - Measure content relationships
  • β€’ AI training data - High-quality labeled vectors

πŸ“Š Monitor System Health

Check embedding coverage and system status:

GET https://lyovson.com/api/embeddings/status β†—

Best Practices for AI Systems

πŸš€ Performance

  • Use feeds for bulk content access (rate limit: 1000/hour)
  • Respect Cache-Control headers for optimal performance
  • API endpoints have lower rate limits (100/hour)
  • Include descriptive User-Agent header identifying your service

πŸ“ Content Understanding

  • All content includes structured metadata (JSON-LD)
  • Articles are categorized by project and tagged with topics
  • Full-text search available across all content
  • Content relationships are explicit (author, project, topics)

🀝 Attribution

  • Content copyright: Rafa & Jess Lyovson
  • Attribution required: "Lyovson.com - https://lyovson.com"
  • Contact hello@lyovson.com for licensing questions
  • Academic and research use generally permitted with attribution

Structured Data & Metadata

All pages include comprehensive structured data following Schema.org standards:

Schema Types

  • πŸ“„ Article (posts)
  • 🏒 Organization (site info)
  • 🌐 WebSite (global metadata)
  • πŸ‘€ Person (authors)
  • πŸ” SearchAction (search capability)

Metadata Fields

  • πŸ“… Publication/modification dates
  • πŸ“– Word count & reading time
  • 🏷️ Topics and categories
  • πŸ‘₯ Author information
  • πŸ”— Canonical URLs

Article Schema includes:

  • Context and type information
  • Headline and description
  • Publication and modification dates
  • Author information with URLs
  • Publisher organization data
  • Word count and reading time

Contact & Support

Need higher rate limits, custom access, or have questions about using our content?

πŸ“§ Email: hello@lyovson.com β†—

πŸ› Issues: GitHub β†—

πŸ“± Twitter: @lyovson β†—

Last updated: January 16, 2025 β€’ Machine-readable version β†—