Viegas, Carlos Manuel DiasOliveira, Isaac Gomes de2023-07-142023-07-142023-07-10OLIVEIRA, Isaac Gomes de. Arquitetura Escalável de Streaming de Dados de API Utilizando Apache Kafka. Orientador: Carlos Manuel Dias Viegas. 2023. 56 f. Trabalho de Conclusão de Curso (Graduação em Engenharia de Computação) - Departamento de Computação e Automação, Universidade Federal do Rio Grande do Norte, Natal, 2023.https://repositorio.ufrn.br/handle/123456789/53384Data streaming has become notorious in the context of Big Data. The need to deal with information near the time it is produced has become fundamental in several scenarios in view of the perceptions that this offers. Streaming tools implementation have been improved and popularized in recent years and Apache Kafka stands out among them for covering the necessary guarantees for the transmission of information in a resilient environment. Handling Kafka and scaling it for modern applications is the starting point for delivering real-time data. Added to this, whereas the amount of information currently available via Application Program Interfaces (APIs), it is pertinent to have solutions that capture this information and stream it for different purposes. This work supports this demand by exploiting Kafka's resources, building a resilient and scalable architecture that can be easily replicated because it is containerized. It also explores the Go language for developing services that fetch and process data from APIs. At the end of the work, validations of availability, durability and fault tolerance of the solution are carried out, exposing the circumstances to which this type of architecture can experience, as well as the scalability provided by it, which proves to be sufficient to meet the demand processing of the API used. It concludes with the presentation of an application that consumes and show data in real-time, demonstrating an use case of the solution and its practical effect in data streaming scenario.Streaming de dadosApache KafkaAPIsTempo realData streamingReal-TimebachelorThesis