Luis Goicochea

- Optimized AWS infrastructure, managing ECS Fargate, EFS, and load balancers, and securing WordPress deployment with Cloudflare, IAM, WAF, and GuardDuty. Automated CI/CD with Jenkins, Bitbucket, and AWS CodePipeline. - Developed AI-driven scrapers (Crawl4AI, Open WebUI, FireCrawl) with captcha bypassing & infinite scroll handling. Built ETL pipelines using Airflow, AWS Glue, and PySpark, processing Parquet and Avro data in S3 for scalable analytics.

- Optimized batch and real-time pipelines with AWS Glue, Databricks, and Kafka, reducing compute costs with Delta Lake. - Migrated OLAP cubes from Azure Analysis Services to S3 and Databricks, automating schema updates in Parquet. - Enabled real-time SAP S/4HANA ingestion via API Gateway using SAP OData connectors.

- Led OracleDB-to-Azure Data Lake migration for BCP, optimizing ingestion with PySpark and Databricks. Architected real-time pipelines for Telefónica using NiFi, PySpark, Kafka, and Hadoop, enhancing performance with HDFS, Hive, and Databricks. - Automated CI/CD deployments across Azure Synapse, HDInsight, Databricks, and NoSQL systems using Jenkins, Terraform, Bitbucket, and Azure DevOps.