@openpj
Piergiorgio LucidiFounder▲5L2
Solution Architect, TAI Solutions
1h ago · New project in Agents · Rome

Shipped: OpenCrawling

OpenCrawling is a high-performance enterprise data ingestion and security mapping framework. Powered by Java 25 and Spring Boot 4, it orchestrates secure pipelines using Apache Tika for text extraction, Apache Kafka for queueing, Apache Ozone & S3 for distributed payload storage, Redis for caching, and Ollama for embeddings while preserving document permissions (ACLs).

OpenCrawling logoOpenCrawling@openpj/opencrawling · opencrawling.org
RAGSpring AIJava 25EmbeddingData FederationData LiberationPipelineRAG Pipeline

0 comments

Log in to join the thread.