package cloud
import "cloud.google.com/go"
Package cloud is the root of the packages used to access Google Cloud Services. See https://godoc.org/cloud.google.com/go for a full list of sub-packages.
Client Options
All clients in sub-packages are configurable via client options. These options are described here: https://godoc.org/google.golang.org/api/option.
Authentication and Authorization
All the clients in sub-packages support authentication via Google Application Default Credentials (see https://cloud.google.com/docs/authentication/production), or by providing a JSON key file for a Service Account. See the authentication examples in this package for details.
Timeouts and Cancellation
By default, all requests in sub-packages will run indefinitely, retrying on transient errors when correctness allows. To set timeouts or arrange for cancellation, use contexts. See the examples for details.
Do not attempt to control the initial connection (dialing) of a service by setting a timeout on the context passed to NewClient. Dialing is non-blocking, so timeouts would be ineffective and would only interfere with credential refreshing, which uses the same context.
Connection Pooling
Connection pooling differs in clients based on their transport. Cloud clients either rely on HTTP or gRPC transports to communicate with Google Cloud.
Cloud clients that use HTTP (bigquery, compute, storage, and translate) rely on the underlying HTTP transport to cache connections for later re-use. These are cached to the default http.MaxIdleConns and http.MaxIdleConnsPerHost settings in http.DefaultTransport.
For gRPC clients (all others in this repo), connection pooling is configurable. Users of cloud client libraries may specify option.WithGRPCConnectionPool(n) as a client option to NewClient calls. This configures the underlying gRPC connections to be pooled and addressed in a round robin fashion.
Using the Libraries with Docker
Minimal docker images like Alpine lack CA certificates. This causes RPCs to appear to hang, because gRPC retries indefinitely. See https://github.com/GoogleCloudPlatform/google-cloud-go/issues/928 for more information.
Debugging
To see gRPC logs, set the environment variable GRPC_GO_LOG_SEVERITY_LEVEL. See https://godoc.org/google.golang.org/grpc/grpclog for more information.
For HTTP logging, set the GODEBUG environment variable to "http2debug=1" or "http2debug=2".
Google Application Default Credentials is the recommended way to authorize
and authenticate clients.
For information on how to create and obtain Application Default Credentials, see
https://developers.google.com/identity/protocols/application-default-credentials.
Code:play
To arrange for an RPC to be canceled, use context.WithCancel.
Code:play
You can use a file with credentials to authenticate and authorize, such as a JSON
key file associated with a Google service account. Service Account keys can be
created and downloaded from
https://console.developers.google.com/permissions/serviceaccounts.
This example uses the Datastore client, but the same steps apply to
the other client libraries underneath this package.
Code:play
In some cases (for instance, you don't want to store secrets on disk), you can
create credentials from in-memory JSON and use the WithCredentials option.
The google package in this example is at golang.org/x/oauth2/google.
This example uses the PubSub client, but the same steps apply to
the other client libraries underneath this package.
Code:play
To set a timeout for an RPC, use context.WithTimeout.
Code:play
Example (ApplicationDefaultCredentials)¶
package main
import (
"cloud.google.com/go/datastore"
"golang.org/x/net/context"
)
func main() {
client, err := datastore.NewClient(context.Background(), "project-id")
if err != nil {
// TODO: handle error.
}
_ = client // Use the client.
}
Example (Cancellation)¶
package main
import (
"cloud.google.com/go/bigquery"
"golang.org/x/net/context"
)
func main() {
ctx := context.Background()
// Do not cancel the context passed to NewClient: dialing happens asynchronously,
// and the context is used to refresh credentials in the background.
client, err := bigquery.NewClient(ctx, "project-id")
if err != nil {
// TODO: handle error.
}
cctx, cancel := context.WithCancel(ctx)
defer cancel() // Always call cancel.
// TODO: Make the cancel function available to whatever might want to cancel the
// call--perhaps a GUI button.
if err := client.Dataset("new-dataset").Create(cctx, nil); err != nil {
// TODO: handle error.
}
}
Example (CredentialsFile)¶
package main
import (
"cloud.google.com/go/datastore"
"golang.org/x/net/context"
"google.golang.org/api/option"
)
func main() {
client, err := datastore.NewClient(context.Background(),
"project-id", option.WithCredentialsFile("/path/to/service-account-key.json"))
if err != nil {
// TODO: handle error.
}
_ = client // Use the client.
}
Example (CredentialsFromJSON)¶
package main
import (
"cloud.google.com/go/pubsub"
"golang.org/x/net/context"
"golang.org/x/oauth2/google"
"google.golang.org/api/option"
)
func main() {
ctx := context.Background()
creds, err := google.CredentialsFromJSON(ctx, []byte("JSON creds"), pubsub.ScopePubSub)
if err != nil {
// TODO: handle error.
}
client, err := pubsub.NewClient(ctx, "project-id", option.WithCredentials(creds))
if err != nil {
// TODO: handle error.
}
_ = client // Use the client.
}
Example (Timeout)¶
package main
import (
"time"
"cloud.google.com/go/bigquery"
"golang.org/x/net/context"
)
func main() {
ctx := context.Background()
// Do not set a timeout on the context passed to NewClient: dialing happens
// asynchronously, and the context is used to refresh credentials in the
// background.
client, err := bigquery.NewClient(ctx, "project-id")
if err != nil {
// TODO: handle error.
}
// Time out if it takes more than 10 seconds to create a dataset.
tctx, cancel := context.WithTimeout(ctx, 10*time.Second)
defer cancel() // Always call cancel.
if err := client.Dataset("new-dataset").Create(tctx, nil); err != nil {
// TODO: handle error.
}
}
Index ¶
Examples ¶
- package (ApplicationDefaultCredentials)
- package (Cancellation)
- package (CredentialsFile)
- package (CredentialsFromJSON)
- package (Timeout)
Source Files ¶
cloud.go
Directories ¶
Path | Synopsis |
---|---|
asset | |
asset/v1beta1 | Package asset is an auto-generated package for the Cloud Asset API. |
bigquery | Package bigquery provides a client for the BigQuery service. |
bigquery/datatransfer | |
bigquery/datatransfer/apiv1 | Package datatransfer is an auto-generated package for the BigQuery Data Transfer API. |
bigtable | Package bigtable is an API to Google Cloud Bigtable. |
bigtable/bttest | Package bttest contains test helpers for working with the bigtable package. |
bigtable/cmd | |
bigtable/cmd/cbt | Cbt is a tool for doing basic interactions with Cloud Bigtable. |
bigtable/cmd/emulator | cbtemulator launches the in-memory Cloud Bigtable server on the given address. |
bigtable/cmd/loadtest | Loadtest does some load testing through the Go client library for Cloud Bigtable. |
bigtable/cmd/scantest | Scantest does scan-related load testing against Cloud Bigtable. |
bigtable/internal | |
civil | Package civil implements types for civil time, a time-zone-independent representation of time that follows the rules of the proleptic Gregorian calendar with exactly 24-hour days, 60-minute hours, and 60-second minutes. |
cloudtasks | |
cloudtasks/apiv2beta2 | Package cloudtasks is an auto-generated package for the Cloud Tasks API. |
cloudtasks/apiv2beta3 | Package cloudtasks is an auto-generated package for the Cloud Tasks API. |
cmd | |
cmd/go-cloud-debug-agent | |
cmd/go-cloud-debug-agent/internal | |
compute | |
compute/metadata | Package metadata provides access to Google Compute Engine (GCE) metadata and API service accounts. |
container | Package container contains a deprecated Google Container Engine client. |
containeranalysis | |
containeranalysis/apiv1beta1 | Package containeranalysis is an auto-generated package for the Container Analysis API. |
container/apiv1 | Package container is an auto-generated package for the Google Container Engine API. |
dataproc | |
dataproc/apiv1 | Package dataproc is an auto-generated package for the Google Cloud Dataproc API. |
dataproc/apiv1beta2 | Package dataproc is an auto-generated package for the Google Cloud Dataproc API. |
datastore | Package datastore provides a client for Google Cloud Datastore. |
debugger | |
debugger/apiv2 | Package debugger is an auto-generated package for the Stackdriver Debugger API. |
dialogflow | |
dialogflow/apiv2 | Package dialogflow is an auto-generated package for the Dialogflow API. |
dlp | |
dlp/apiv2 | Provides methods for detection, risk analysis, and de-identification of privacy-sensitive fragments in text, images, and Google Cloud Platform storage repositories. |
errorreporting | Package errorreporting is a Google Stackdriver Error Reporting library. |
errorreporting/apiv1beta1 | Package errorreporting is an auto-generated package for the Stackdriver Error Reporting API. |
firestore | Package firestore provides a client for reading and writing to a Cloud Firestore database. |
firestore/apiv1beta1 | Package firestore is an auto-generated package for the Google Cloud Firestore API. |
firestore/genproto | |
firestore/internal | |
functions | |
functions/metadata | Package metadata provides methods for creating and accessing context.Context objects with Google Cloud Functions metadata. |
httpreplay | Package httpreplay provides an API for recording and replaying traffic from HTTP-based Google API clients. |
httpreplay/cmd | |
httpreplay/cmd/httpr | |
httpreplay/internal | |
iam | Package iam supports the resource-specific operations of Google Cloud IAM (Identity and Access Management) for the Google Cloud Libraries. |
iam/admin | |
iam/admin/apiv1 | Package admin is an auto-generated package for the Google Identity and Access Management (IAM) API. |
iam/credentials | |
iam/credentials/apiv1 | Package credentials is an auto-generated package for the IAM Service Account Credentials API. |
internal | |
kms | |
kms/apiv1 | Manages keys and performs cryptographic operations in a central cloud service, for direct use by other cloud resources and applications. |
language | |
language/apiv1 | Google Cloud Natural Language API provides natural language understanding technologies to developers. |
language/apiv1beta2 | Package language is an auto-generated package for the Google Cloud Natural Language API. |
logging | Package logging contains a Stackdriver Logging client suitable for writing logs. |
logging/apiv2 | Package logging is an auto-generated package for the Stackdriver Logging API. |
logging/internal | |
logging/logadmin | Package logadmin contains a Stackdriver Logging client that can be used for reading logs and working with sinks, metrics and monitored resources. |
longrunning | Package longrunning supports Long Running Operations for the Google Cloud Libraries. |
longrunning/autogen | Package longrunning is an auto-generated package for the Google Long Running Operations API. |
monitoring | |
monitoring/apiv3 | Package monitoring is an auto-generated package for the Stackdriver Monitoring API. |
oslogin | |
oslogin/apiv1 | Package oslogin is an auto-generated package for the Google Cloud OS Login API. |
oslogin/apiv1beta | Package oslogin is an auto-generated package for the Google Cloud OS Login API. |
profiler | Package profiler is a client for the Stackdriver Profiler service. |
profiler/busybench | Busybench is a tool that runs a benchmark with the profiler enabled. |
profiler/mocks | Package mocks is a generated GoMock package. |
profiler/proftest | |
pubsub | Package pubsub provides an easy way to publish and receive Google Cloud Pub/Sub messages, hiding the the details of the underlying server RPCs. |
pubsub/apiv1 | Package pubsub is an auto-generated package for the Google Cloud Pub/Sub API. |
pubsub/internal | |
pubsub/loadtest | Package loadtest implements load testing for pubsub, following the interface defined in https://github.com/GoogleCloudPlatform/pubsub/tree/master/load-test-framework/ . |
pubsub/loadtest/cmd | |
pubsub/loadtest/pb | Package google_pubsub_loadtest is a generated protocol buffer package. |
pubsub/pstest | Package pstest provides a fake Cloud PubSub service for testing. |
redis | |
redis/apiv1 | The Google Cloud Memorystore for Redis API is used for creating and managing Redis instances on the Google Cloud Platform. |
redis/apiv1beta1 | Package redis is an auto-generated package for the Google Cloud Memorystore for Redis API. |
rpcreplay | Package rpcreplay supports the capture and replay of gRPC calls. |
rpcreplay/proto | |
rpcreplay/proto/intstore | Package intstore is a generated protocol buffer package. |
rpcreplay/proto/rpcreplay | Package rpcreplay is a generated protocol buffer package. |
spanner | Package spanner provides a client for reading and writing to Cloud Spanner databases. |
spanner/admin | |
spanner/admin/database | |
spanner/admin/database/apiv1 | Package database is an auto-generated package for the Cloud Spanner Database Admin API. |
spanner/admin/instance | |
spanner/admin/instance/apiv1 | Package instance is an auto-generated package for the Cloud Spanner Instance Admin API. |
spanner/apiv1 | Package spanner is an auto-generated package for the Cloud Spanner API. |
spanner/internal | |
speech | |
speech/apiv1 | Converts audio to text by applying powerful neural network models. |
speech/apiv1p1beta1 | Package speech is an auto-generated package for the Cloud Speech API. |
storage | Package storage provides an easy way to work with Google Cloud Storage. |
texttospeech | |
texttospeech/apiv1 | Package texttospeech is an auto-generated package for the Cloud Text-to-Speech API. |
trace | This package is OBSOLETE. |
trace/apiv1 | Package trace is an auto-generated package for the Stackdriver Trace API. |
trace/apiv2 | Package trace is an auto-generated package for the Stackdriver Trace API. |
translate | Package translate is a client for the Google Translation API. |
translate/internal | |
videointelligence | |
videointelligence/apiv1 | Package videointelligence is an auto-generated package for the Cloud Video Intelligence API. |
videointelligence/apiv1beta1 | Package videointelligence is an auto-generated package for the Google Cloud Video Intelligence API. |
videointelligence/apiv1beta2 | Package videointelligence is an auto-generated package for the Google Cloud Video Intelligence API. |
vision | |
vision/apiv1 | Integrates Google Vision features, including image labeling, face, logo, and landmark detection, optical character recognition (OCR), and detection of explicit content, into applications. |
vision/apiv1p1beta1 | Package vision is an auto-generated package for the Google Cloud Vision API. |
Tools for package owners.