Search Results

Kubernetes What It Does: Kubernetes manages the deployment, scaling, and operation of containerized applications. Role in Logging: It generates logs from various workloads (pods, services, etc.). Provides APIs for log collection via kubectl logs or via l...

1. Loki Storage Backend Loki stores logs in a backend system that is configured when Loki is deployed. It uses two main components for storage: a. Index Store Stores metadata (labels, timestamps, etc.) to allow quick search and filtering of logs. By default, ...

1. What is MinIO? MinIO is a high-performance, distributed object storage system that is compatible with the Amazon S3 API. It's often used in self-hosted environments to provide object storage for applications like Loki. 2. How Loki Uses MinIO Loki stores ...

1. loki-minio-0 MinIO Object Storage Server Copyright: 2015-2022 MinIO, Inc. License: GNU AGPLv3 <https://www.gnu.org/licenses/agpl-3.0.html> Version: RELEASE.2022-09-17T00-09-45Z (go1.18.6 linux/amd64) Status: 2 Online, 0 Offline. API: http://10.42....

1. Prerequisites Install Docker and Docker Compose: Install Docker Install Docker Compose 2. Create a Docker Compose File Set up a docker-compose.yaml file to simulate the environment. version: "3.9" services: loki: image: grafana/loki:latest p...

1. Get the Layer ARN Ensure you have the full ARN of the Lambda Layer. It typically looks like: arn:aws:lambda:<region>:<account-id>:layer:<layer-name>:<version> For example: arn:aws:lambda:us-east-1:123456789012:layer:my-nodejs-layer:3 2. Download the Layer...

Cannot find package 'uuid' imported from /var/task/index.mjs If your Lambda Layer contains @types/uuid but not the actual uuid package, it means you only have the TypeScript type definitions installed, not the actual library. The @types/uuid package provides t...

Configure AWS Credential: aws configure Show list of configuration aws configure list Check Bucket List on Loki-Minio aws --endpoint-url http://<server-ip>:9000 s3 ls Show Bucket Contents Recursively aws --endpoint-url http://localhost:9000 s3 ls s3://chunk...

Configure Credentials: aws configure List of Configured Credentials: aws configure list

Settings [INPUT] Name tail Path /var/external_logs/*.log Tag local.* Refresh_Interval 5 DB /fluent-bit/logs/fluent-bit.db DB.Sync Normal Parser json Ro...

Docker Compose ... fluent-bit: build: context: ./fluent-bit volumes: - ./fluent-bit-logs:/var/log - ./fluent-bit-src-logs:/var/source_logs - ./fluent-bit-dst-logs:/var/destination_logs - ./fluent-bit-db:/fluent-bit/logs...

Run server: php artisan server --port <port-number> Clear configuration: php artisan config:clear

Kubernetes Command Not Found 2024-11-22 06:00:02 - Script execution started. /data/scripts/log_cleaner.sh: line 60: kubectl: command not found 2024-11-22 06:00:02 - No pods found matching the patterns in namespace prd-ns. Solution: which kubectl Replace kube...

server: http_listen_port: 9080 grpc_listen_port: 0 clients: - url: http://loki:3100/loki/api/v1/push batchsize: 512000 batchwait: 1s positions: filename: /tmp/positions.yaml scrape_configs: - job_name: system static_configs: - targe...

Docker Compose version: '3.8' services: s3-downloader: build: . volumes: - ./logs:/logs - ./.s3cfg:/root/.s3cfg entrypoint: ["/usr/local/bin/download_logs.sh"] Dockerfile # Use an official lightweight image with bash FROM alpine:3.17...

Download mc: wget https://dl.min.io/client/mc/release/linux-amd64/mc chmod +x mc sudo mv mc /usr/local/bin/ Check Log Index Data ./mc alias set minio http://minio:9000 enterprise-logs supersecret ./mc ls minio ./mc find minio/chunks --older-than 120d --print ...

apiVersion: apps/v1 kind: StatefulSet metadata: name: data-mover namespace: loki spec: serviceName: "data-mover-service" replicas: 1 selector: matchLabels: app: data-mover template: metadata: labels: app: data-mover ...

kubectl get pvc -n loki export-0-loki-minio-0 -o yaml > export-0-loki-minio-0.yaml kubectl apply -f export-0-loki-minio-0.yaml kubectl get pvc -n loki kubectl cp /home/root/backup/chunks/ loki-minio-test-0:/export-test-0/chunks/ -n loki kubectl cp backup/chunk...

Run this command in RabbitMQ's container. rabbitmq-plugins enable rabbitmq_management Open http://localhost:15672 on your browser. This is the login info: Username: guest Password: guest

Enter the pod by this command. kubectl exec -ti -n <namespace> <pod-name> -- /bin/bash Check the pod's deployment. kubectl get deployment -n <namespace> <pod-name> -o yaml > rabbitmq.yaml