Big Query
- Big Query is Google clouds fully managed serverless and highly scalable data warehouse service
- It is designed for fast SQL queries and large scale data analytics
Use Cases
- Data warehousing and large scale data analytics
- Business Intelligence and Reporting
- Real-time analytics on streaming data from IoT or web sources
Features
- Fully serverless with automatic scaling
- Designed for fast analytics on petabytes of data
- Supports standard SQL Queries
- Integrated with GCS, Dataflow and AI/ML Services
- Built in maching learning with BigQuery ML
Decoupling applications with Pub/Sub
- pub/sub is a messaging service that allows us to decouple applications that produce events and recieve events
- Fundamentals concepts of this technology
- Topic: This corresponds to the resources where publishers send their messages
- Subscription: this corresponds to the resources that represent flow of messsages from a specific topic to a particular subscriber
- Message: This is the message published.
- Pub/Sub Types
- Pub/sub: multi zone type pub/sub version with automatic provisiong, unlimited storage per topic, message retention up to 7 days and global endpoint exposures
- Pub/sub lite: single zone type pub/sub version, maximum storage of 10 TB per topic and unlimited message retention and exposure of regional global endpoint
- Patterns
- Fan in: multiple publishers send messages to multiple topics that are consumed by a single subscriber (many to one)
- Many to Many: Multiple publishers send messages to multiple topics consumed by multiple subscribers
- Fan out: A publisher posts a message on topic that is consumed by multiple subscribers (one to many)
- Refer Here for python example of pub/sub
Integration Services
Cloud Scheduler
- A Fully managed cron job service from gcp
ApiGee
- This is a powerful API Management Platform that helps organizations design, secure, deploy, monitor and scale APIs.
- It acts a gateway for APIs providing features that ensure security, performance and reliability making it easier for developers to create and manage API while maintaining control over access, data and analytics
- Features:
- API Design and Development
- Security
- Traffic Management: Ratelimiting, quotas and caching
- Analytics and Montioring
- Developer Port
- Lifecycle Management
- Policy Enforcement
- Integration with GCP Services
- Usecases:
- Microservice Management
- Modernizing legacy systems
- Monetization
