EDUCBA

EDUCBA

MENUMENU
  • Free Tutorials
  • Free Courses
  • Certification Courses
  • 360+ Courses All in One Bundle
  • Login
Home Data Science Data Science Tutorials TensorFlow Tutorial TensorFlow Architecture
Secondary Sidebar
TensorFlow Tutorial
  • Basics
    • Introduction to Tensorflow
    • What is TensorFlow?
    • Tensorflow Basics
    • TensorFlow Architecture
    • TensorFlow Versions
    • How to Install TensorFlow
    • Caffe TensorFlow
    • Tensorflow Image Classification
    • TensorFlow Playground
    • TensorFlow RNN
    • TensorFlow Models
    • TensorBoard
    • TensorFlow Debugging
    • TensorFlow vs Keras
    • Tensorflow LSTM
    • TensorFlow Probability
    • TensorFlow Session
    • TensorFlow Dataset
    • TensorFlow Reshape
    • TensorFlow estimator
    • TensorFlow Keras Model
    • TensorFlow Load Model
    • tensorflow transformer
    • tensorflow extended
    • tensorflow flatten
    • TensorFlow OpenCL
    • TensorFlow APIs
    • Tensorflow concatenate
    • Tensorflow variable
    • TensorFlow normalize
    • TensorFlow save model
    • TensorFlow placeholder
    • TensorFlow shape
    • TensorFlow Adam optimizer
    • TensorFlow dense
    • Tensorflow Quantum
    • TensorFlow Layers
    • TensorFlow Distributed
    • TensorFlow Profiler
    • TensorFlow Metrics
    • TensorFlow Transpose
    • TensorFlow Tensor To Numpy
    • TensorFlow Quantization
    • TensorFlow Regression
    • TensorFlow argmax
    • TensorFlow Federated
    • TensorFlow gather
    • TensorFlow Random Forest
    • Tensorflow sequential
    • TensorFlow expand_dims

Related Courses

TensorFlow Training Course

Machine Learning Courses

Artificial Intelligence Training Course

TensorFlow Architecture

By Priya PedamkarPriya Pedamkar

TensorFlow Architecture

Introduction to TensorFlow

In this article, we will see an outline on TensorFlow Architecture. TensorFlow is a cross-platform library, and there are some common concepts like operations, sessions, and computation graphs. TensorFlow Serving makes new algorithms and experiments easy to deploy while retaining the same database architecture and APIs.

What is Tensorflow Architecture?

An Architecture of TensorFlow

Tensorflow is a commonly used deep learning library, which is built by the Google brain team that was working on Artificial Intelligence. It was developed as it can be used on multiple CPUs, GPUs, and can run on mobile devices and supports different wrapper classes like python, C++ or Java and Tensors, which describe the linear relation between vectors, scalars, and other tensors.

Tensors are nothing but multidimensional arrays. For understanding the TensorFlow architecture and features, first, we need to understand some terms.

Start Your Free Data Science Course

Hadoop, Data Science, Statistics & others

All in One Data Science Bundle(360+ Courses, 50+ projects)
Python TutorialMachine LearningAWSArtificial Intelligence
TableauR ProgrammingPowerBIDeep Learning
Price
View Courses
360+ Online Courses | 50+ projects | 1500+ Hours | Verifiable Certificates | Lifetime Access
4.7 (86,241 ratings)
  1. Tensorflow Servables
  2. Servable Versions
  3. Servable Streams
  4. Tensorflow Model
  5. Tensorflow Loaders
  6. Tensorflow Sources
  7. Tensorflow Manager
  8. Tensorflow Core
  9. Life of Servable
  10. Batcher In Tensorflow architecture

1. Tensorflow Servables

  • Tensorflow Servables are common objects that are mainly used to perform computation. The size of the TensorFlow servable is very flexible. Servables are central uncompleted units in TensorFlow serving.
  • A servable unit can contain anything like it can contain tuples, lookup tables. Servable objects can be of any type and any interface. These features are very flexible and easy to make future improvements such as Asynchronous modes of operations, Streaming results, and Experimental APIs.

2. Servable Versions

  • Servable versions are used for maintaining versions of TensorFlow servable. It can handle one or more versions of Servables. It can help configure the new algorithms, handle weights, and other changes can be done, data can be loaded.
  • It also can change and manage versions, enable multiple servable versions at a time.

3. Servable Streams

It is a collection of different versions of Servables. It stores it in an increasing sequence of versions.

4. Tensorflow Models

  • A TensorFlow model can contain one or more TensorFlow Servables. It is mainly used in machine learning tasks containing more than one algorithm that contains different weights according to model, lookup tables, metrics and table embeddings.
  • It can be served in many different ways such that there are different ways to serve the lookup table.

5. Tensorflow Loaders

  • Tensorflow loader is an API that manages the TensorFlow Servables life cycle. It provides a common infrastructure for some of the learning algorithms.
  • The main use of the TensorFlow loader is to load and unload Servables using standardized loader APIs.

6. Tensorflow Sources

  • Sources are work as a plugin module. Tensorflow source does the basic handling of servable like the finding of servable, provide servable on the request.
  • Each reference can provide one or more servable streams at a time. Each source provides a loader instance for handling the version of the stream. And each servable stream is loaded on the version based.
  • Source have different states that can be shared with different versions and to multiple Servables. Can also handle update or change between versions.

7. Tensorflow Managers

  • Tensorflow manager handles the end to the end life cycle of servable.
  • Loading Servable, Serving Servable, Unloading Servable.
  • A manager gets a response from all servable sources and also monitor all version of it. The manager can also refuse or postpone the upload.
  • GetServableHandle() function provides an interface that helps to handle managerial things about TensorFlow Servables.

8. Tensorflow Core

Tensorflow Core contains:

  • Lifecycle Metrics.
  • Tensorflow serving core takes servables and loaders as an object.

TensorFlow Core

9. Life of a Servable

The whole procedure is explained about how servable is used and the whole life cycle of servable:

  • Source create loaders for different servable versions. The client requested that the manager and manager send the loaders aspired version, load and served back to the client.
  • Loader contains metadata that can be used to load the Servables. A callback is used to notify the manager about the servable source versions. The manager follows a version policy that helps to configure and decide what action to be needed next.
  • The manager also checks the loaders’ security; if it is safe, it will give the necessary resources to the loader and permit to load the new version. The manager provides Severable on the client request. It will request a specific version explicitly or direct the latest version after that manager returns a handle for access the servable.
  • The Dynamic manager handles the servable versions, apply the version policy and decides the version or latest version needs to be loaded. The dynamic manager allocates memory to the loader. Loader initiates the TensorFlow graph and updates the weights of the TensorFlow graph.
  • When a client requests the servable and checks the client’s version, then the Dynamic manager returns that handler with the requested version of Servable.

10. Batcher in Tensorflow Architecture

  • Batching is a procedure of handling multiple requests into a single request.
  • Using this procedure, we can reduce the cost of performing inferences, especially the acceleration of hardware like GPU, TPU.
  • Tensorflow servable contains a Batcher widget, by using this widget client can easily batch their multiple specific inference requests into a single batch request. So they can run this procedure efficiently.

Conclusion – TensorFlow Architecture

Tensorflow Architecture represents a decentralized system. It shows how different components work and serve their roles in a decentralized system. Serving on the client’s request and using batching multiple operations parallel. Some of TensorFlow architecture’s best features are batching the operations, hardware acceleration, dynamic manager options, loaders, sources, and servable streams.

Recommended Articles

This is a guide to TensorFlow Architecture. Here we discuss What is TensorFlow and some of the best features in TensorFlow Architecture. You can also go through our other suggested articles to learn more –

  1. Introduction to Tensorflow with Characteristic
  2. TensorFlow vs Spark | Top 5 Comparison
  3. Theano vs Tensorflow – Top differences
  4. TensorFlow Alternatives | Top 11
  5. TensorFlow Models | Top 5 Models of TensorFlow
  6. Overview and Different Versions of TensorFlow
  7. Mxnet vs TensorFlow | Top Differences
Popular Course in this category
TensorFlow Training (11 Courses, 3+ Projects)
  11 Online Courses |  3 Hands-on Projects |  55+ Hours |  Verifiable Certificate of Completion
4.5
Price

View Course

Related Courses

Machine Learning Training (20 Courses, 29+ Projects)4.9
Artificial Intelligence AI Training (5 Courses, 2 Project)4.8
0 Shares
Share
Tweet
Share
Primary Sidebar
Footer
About Us
  • Blog
  • Who is EDUCBA?
  • Sign Up
  • Live Classes
  • Corporate Training
  • Certificate from Top Institutions
  • Contact Us
  • Verifiable Certificate
  • Reviews
  • Terms and Conditions
  • Privacy Policy
  •  
Apps
  • iPhone & iPad
  • Android
Resources
  • Free Courses
  • Database Management
  • Machine Learning
  • All Tutorials
Certification Courses
  • All Courses
  • Data Science Course - All in One Bundle
  • Machine Learning Course
  • Hadoop Certification Training
  • Cloud Computing Training Course
  • R Programming Course
  • AWS Training Course
  • SAS Training Course

ISO 10004:2018 & ISO 9001:2015 Certified

© 2022 - EDUCBA. ALL RIGHTS RESERVED. THE CERTIFICATION NAMES ARE THE TRADEMARKS OF THEIR RESPECTIVE OWNERS.

EDUCBA
Free Data Science Course

SPSS, Data visualization with Python, Matplotlib Library, Seaborn Package

*Please provide your correct email id. Login details for this Free course will be emailed to you

By signing up, you agree to our Terms of Use and Privacy Policy.

EDUCBA Login

Forgot Password?

By signing up, you agree to our Terms of Use and Privacy Policy.

EDUCBA
Free Data Science Course

Hadoop, Data Science, Statistics & others

*Please provide your correct email id. Login details for this Free course will be emailed to you

By signing up, you agree to our Terms of Use and Privacy Policy.

EDUCBA

*Please provide your correct email id. Login details for this Free course will be emailed to you

By signing up, you agree to our Terms of Use and Privacy Policy.

Let’s Get Started

By signing up, you agree to our Terms of Use and Privacy Policy.

This website or its third-party tools use cookies, which are necessary to its functioning and required to achieve the purposes illustrated in the cookie policy. By closing this banner, scrolling this page, clicking a link or continuing to browse otherwise, you agree to our Privacy Policy

Loading . . .
Quiz
Question:

Answer:

Quiz Result
Total QuestionsCorrect AnswersWrong AnswersPercentage

Explore 1000+ varieties of Mock tests View more