Ingest Logs

You can load your logs into Oracle Cloud Logging Analytics using the Oracle Management Agent, uploading logs on-demand, collecting them from OCI Object Store, or using Service Connector.

Ensure to complete the prerequisites for configuring Oracle Cloud Logging Analytics. You must have the permissions listed in Minimum Set of IAM Policies Required to Use Logging Analytics. The permissions required to ingest logs are detailed in the corresponding section depending on the method of ingestion you select.

Typically, you would select one of these methods depending on your use case and how you are able to access the logs:

  • Set Up Continuous Log Collection From Your Hosts

    Install Management Agents on your on-premises hosts to continuously collect logs in Oracle Cloud Logging Analytics. This is a one-time setup.

  • Upload Logs on Demand

    This is useful when you have log data from old applications that aren’t supported by the Oracle Management Agent or you want to load a log file a single time to analyze them.

  • Collect Logs from Your OCI Object Storage Bucket

    You can continuously collect log data that you have stored in an Oracle Cloud Object Store bucket.

  • Ingest Logs from Other OCI Services Using Service Connector

    Use the Service Connector to identify your Oracle Cloud Infrastructure service as the source of the logs and Oracle Cloud Logging Analytics as the destination and enable the log collection.

  • Harvest Entity Model Data from Enterprise Manager Cloud Control and Collect Logs

    If you are an existing user of EMCC, then you can set up the EM Bridge and benefit from the automated set up that imports their entity model data like the entity associations, and properties information from EMCC into Oracle Cloud Logging Analytics. The entity association information is then used to construct the topology in Oracle Cloud Logging Analytics. To collect your logs from your targets in EMCC, follow the steps described.

  • Ingest Logs to OCI Logging Analytics Using Fluentd

    Use the open source data collector software, Fluentd to collect log data from your source. Install the OCI Logging Analytics Output Plugin to route the collected log data to Oracle Cloud Logging Analytics.

    Note

    Oracle strongly recommends that you use Oracle Cloud Management Agents for the best experience of ingesting log data into Oracle Cloud Logging Analytics. However, if that is not a possible option for your use case, only then use the OCI Logging Analytics Output Plugin for Fluentd.
Note

  • For end-to-end steps to set up database instance monitoring for the database instance records extracted based on the SQL queries that you provide in the log source configuration, see Set Up Database Instance Monitoring.

  • For an example of how to collect logs from tables or views in Oracle Autonomous Database, see Collect Logs from Tables or Views in Oracle Autonomous Database (Tutorial icon Tutorial ).

To detect and troubleshoot the processing errors during ingestion, see Troubleshoot Ingestion Pipeline.