College of Engineering
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
--- Content provided by FirstRanker.com ---
CS6712 – GRID AND CLOUD COMPUTING LABORATORY
VII SEMESTER - R 2013
LABORATORY MANUAL
Name :
Reg. No. :
--- Content provided by FirstRanker.com ---
Section :
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
DHANALAKSHMI
VISION
--- Content provided by FirstRanker.com ---
is committed to provide highly disciplined, conscientious and enterprising
professionals conforming to global standards through value based quality education and training.
MISSION
- To provide competent technical manpower capable of meeting requirements of the industry
- To contribute to the promotion of Academic Excellence in pursuit of Technical Education at different levels
- To train the students to sell his brawn and brain to the highest bidder but to never put a price tag on heart and soul
--- Content provided by FirstRanker.com ---
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
VISION
To strive for acquiring, applying and imparting knowledge in Computer Science and Engineering through quality education and to provide enthusiastic professionals with commitment
MISSION
--- Content provided by FirstRanker.com ---
- To produce highly competent and globally employable engineers in the field of Computer Science and Engineering
- To inculcate human values among the student community and make them realize their commitment to the society
- To exhibit excellence in pursuit of research and innovative products with a zeal to serve the society
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
--- Content provided by FirstRanker.com ---
PROGRAMME EDUCATIONAL OBJECTIVES (PEOS)
1. Fundamentals
To provide students with a solid foundation in Mathematics, Science and fundamentals of engineering, enabling them to apply, to find solutions for engineering problems and use this knowledge to acquire higher education
2. Core Competence
To train the students in Computer science and engineering technologies so that they apply their knowledge and training to compare, and to analyze various engineering industrial problems to find solutions
--- Content provided by FirstRanker.com ---
3. Breadth
To provide relevant training and experience to bridge the gap between theory and practice this enables them to find solutions for the real time problems in industry, and to design products
4. Professionalism
To inculcate professional and effective communication skills, leadership qualities and team spirit in the students to make them multi-faceted personalities and develop their ability to relate engineering issues to broader social context
5. Lifelong Learning/Ethics
--- Content provided by FirstRanker.com ---
To demonstrate and practice ethical and professional responsibilities in the industry and society in the large, through commitment and lifelong learning needed for successful professional career
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
PROGRAMME OUTCOMES (POS)
a) To demonstrate and apply knowledge of Mathematics, Science and engineering fundamentals in Electronics and Communication Engineering field
--- Content provided by FirstRanker.com ---
b) To design a component, a system or a process to meet the specific needs within the realistic constraints such as economics, environment, ethics, health, safety and manufacturability
c) To demonstrate the competency to use software tools for computation, simulation and testing of electronics and communication engineering circuits
d) To identify, formulate and solve electronic and communication engineering problems
e) To demonstrate an ability to visualize and work on laboratory and multidisciplinary tasks
f) To function as a member or a leader in multidisciplinary activities
--- Content provided by FirstRanker.com ---
g) To communicate in verbal and written form with fellow engineers and society at large
h) To understand the impact of Electronics and Communication Engineering in the society and demonstrate awareness of contemporary issues and commitment to give solutions exhibiting social responsibility
i) To demonstrate professional & ethical responsibilities
j) To exhibit confidence in self-education and ability for lifelong learning
k) To participate and succeed in competitive exams
--- Content provided by FirstRanker.com ---
CS6712-GRID AND CLOUD COMPUTING LABORATORY
COURSE OBJECTIVES
SYLLABUS
Learn the working of ARM processor
--- Content provided by FirstRanker.com ---
Understand the Building Blocks of Embedded Systems
Learn the concept of memory map and memory interface
Know the characteristics of Real Time Systems
Write programs to interface memory, I/Os with processor
Study the interrupt performance
--- Content provided by FirstRanker.com ---
LIST OF EXPERIMENTS:
GRID COMPUTING LAB
Use Globus Toolkit or equivalent and do the following:
1. Develop a new Web Service for Calculator.
2. Develop new OGSA-compliant Web Service.
--- Content provided by FirstRanker.com ---
3. Using Apache Axis develop a Grid Service
4. Develop applications using Java or C/C++ Grid APIs
5. Develop secured applications using basic security mechanisms available in Globus Toolkit.
6. Develop a Grid portal, where user can submit a job and get the result. Implement it with and without GRAM concept.
CLOUD COMPUTING LAB
--- Content provided by FirstRanker.com ---
Use Eucalyptus or Open Nebula or equivalent to set up the cloud and demonstrate.
1. Find procedure to run the virtual machine of different configuration. Check how many virtual machines
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
can be utilized at particular time.
--- Content provided by FirstRanker.com ---
2. Find procedure to attach virtual block to the virtual machine and check whether it holds the data even after the release of the virtual machine.
3. Install a C compiler in the virtual machine and execute a sample program.
4. Show the virtual machine migration based on the certain condition from one node to the other.
5. Find procedure to install storage controller and interact with it.
6. Find procedure to set up the one node Hadoop cluster.
--- Content provided by FirstRanker.com ---
7. Mount the one node Hadoop cluster using FUSE.
8. Write a program to use the API's of Hadoop to interact with it.
9. Write a wordcount program to demonstrate the use of Map and Reduce tasks
COURSE OUTCOMES
- Use the grid and cloud tool kits.
- Design and implement applications on the Grid.
- Design and Implement applications on the Cloud.
- Design network objects by applying the networking concepts.
- Create virtualization concept.
- Design web based applications.
- Apply cloud tools for resource allocation.
- Apply grid tools for network translation.
- Design private cloud using open stack.
--- Content provided by FirstRanker.com ---
--- Content provided by FirstRanker.com ---
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
--- Content provided by FirstRanker.com ---
CS6712-GRID AND CLOUD COMPUTING LABORATORY
CONTENTS
| Sl. No. | Name of the Experiment | Page No. |
|---|---|---|
| CYCLE 1 – EXPERIMENTS (GRID COMPUTING) | ||
| 1 | Develop a new Web Service for Calculator | 7 |
| 2 | Develop new OGSA-compliant Web Service | 16 |
| 3 | Using Apache Axis develop a Grid Service | 19 |
| 4 | Develop applications using Java or C/C++ Grid APIs | 22 |
| 5 | Develop secured applications using basic security mechanisms available in Globus Toolkit | 25 |
| 6 | Develop a Grid portal, where user can submit a job and get the result. Implement it with and without GRAM concept | 27 |
| CYCLE 2 – EXPERIMENTS (CLOUD COMPUTING) | ||
| 1 | Find procedure to run the virtual machine of different configuration. Check how many virtual machines can be utilized at particular time | 34 |
| 2 | Find procedure to attach virtual block to the virtual machine and check whether it holds the data even after the release of the virtual machine | 36 |
| 3 | Install a C compiler in the virtual machine and execute a sample program | 39 |
| 4 | Show the virtual machine migration based on the certain condition from one node to the other | 42 |
| 5 | Find procedure to install storage controller and interact with it | 45 |
| 6 | Find procedure to set up the one node Hadoop cluster | 47 |
| 7 | Mount the one node Hadoop cluster using FUSE | |
| ADDITIONAL EXPERIMENTS | ||
| 1 | Write a program to use the API's of Hadoop to interact with it | 52 |
| 2 | Write a wordcount program to demonstrate the use of Map and Reduce tasks | 55 |
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
GRID TECHNOLOGY
--- Content provided by FirstRanker.com ---
INTRODUCTION TO GRID COMPUTING
- Flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions, and resource
- Grid architecture
- Defined using services and protocols
- Using the “sand hourglass” model similar to the TCP/IP protocol stack
--- Content provided by FirstRanker.com ---
"A computational grid is a hardware and software infrastructure that provides dependable, consistent, pervasive and inexpensive access to high-end computational capabilities."
Grid computing makes it possible to dynamically share and coordinate dispersed, heterogeneous computing resources. Flexibility and ubiquity are essential characteristics of Web services technologies such as WSDL (Web Services Description Language), SOAP (Simple Object Access Protocol), and UDDI (Universal Description, Discovery, and Integration).
The Open Grid Services Architecture (OGSA) combines technologies to unlock and exploit grid-attached resources. OGSA defines mechanisms to create, manage, and exchange information between Grid Services, a special type of Web service. The architecture uses WSDL extensively to describe the structure and behavior of a service. Service descriptions are located and discovered using Web Services Inspection Language (WSIL). By combining elements from grid computing and Web services technologies, OGSA establishes an extensible and interoperable design and development framework for Grid Services that includes details for service definition, discovery, and life-cycle management.
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
--- Content provided by FirstRanker.com ---
GLOBUS TOOLKIT
The Globus Toolkit provides software tools to make it easier to build computational grids and grid-based applications. The Globus Toolkit is both an open architecture and open source toolkit.
- The Globus Toolkit is a product of the Globus Alliance (http://www.globus.org)
- It is middleware for developing grids
- The current release is 6.0.
- Four key protocols and APIs
- Grid Security Infrastructure (GSI)
- Grid Resource Allocation & Mgmt (GRAM)
- Grid Resource Information Protocol (GRIP) and Index Information Protocol (GIIP)
- Grid File Transfer Protocol (GridFTP)
- Implementations on many platforms
- Resources, security systems, data model
- Various collective layer protocols & tools
- Info services, replica management, etc.
- A basis for many Grid-enabled tools & apps
- FTP, SSH, Condor, SRB, MPI, EDG, GridPort,
--- Content provided by FirstRanker.com ---
--- Content provided by FirstRanker.com ---
--- Content provided by FirstRanker.com ---
GLOBUS TOOLKIT™ COMPONENTS
- Security
- GSI – Grid Security Infrastructure
- Resource Management
- GRAM – Grid Resource Allocation Manager
- globusrun
- RSL
- gatekeeper
- job manager
- DUROC – Dynamically-Updated Request Online Coallocator
- Information Services
- MDS – Monitoring and Discovery Service
--- Content provided by FirstRanker.com ---
--- Content provided by FirstRanker.com ---
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
--- Content provided by FirstRanker.com ---
- GRIS - Grid Resource Information Service
- GIIS - Grid Index Information Service
- MDS Client
- Data Management
- GridFTP, GASS
--- Content provided by FirstRanker.com ---
The Globus Toolkit latest version 6.0 includes:
GSI: security
GridFTP: file transfer
GRAM: job execution/resource management
MyProxy: credential repository/certificate authority
--- Content provided by FirstRanker.com ---
GSI-OpenSSH: GSI secure single sign-on remote shell
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
GLOBUS TOOLKIT INSTALLATION PROCEDURE
Step1: For installing Globus Toolkit nothing more easy than download the latest package:
--- Content provided by FirstRanker.com ---
http://toolkit.globus.org/ftppub/gt6/installers/repo/globus-toolkit-repo_latest_all.deb
sudodpkg -iglobus-toolkit-repo_latest_all.deb
Step2: Update the repositories: sudo apt-get update
Step3: To install Debian or Ubuntu package, download the globus-toolkit-repo package
from the link above and install it with the command:
--- Content provided by FirstRanker.com ---
root@sysa63:/home/#dpkg -iglobus-toolkit-repo_latest_all.deb
Do the following for Debian-based systems:
root@sysa63:/home/#apt-get install globus-data-management-client
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
--- Content provided by FirstRanker.com ---
Expt.No. 01: DEVELOP A NEW WEB SERVICE FOR CALCULATOR
Aim:
Develop a Web Service for new Calculator
Software Requirements:
Globus Toolkit or equivalent Eucalyptus or Open Nebula or equivalent
--- Content provided by FirstRanker.com ---
Hardware Requirements:
Standalone desktops 30 Nos
Procedure:
1. Our first web service is an extremely simple Math Web Service, which we'll refer to asMathService. It will
2. allow users to perform the following operations:
--- Content provided by FirstRanker.com ---
a. Addition
b. Subtraction
3. Furthermore, MathService will have the following resource properties (RPs for short):
a. Value (integer)
b. Last operation performed (string)
--- Content provided by FirstRanker.com ---
4. We will also add a "Get Value" operation to access the Value RP. Once a new resource is created, the "value" RP is initialized to zero, and the "last operation" RP is initialized to "NONE". The parameter is added/subtracted to the "value" RP, and the "last operation" RP is changed to "ADDITION" or "SUBTRACTION" accordingly. Also, the addition and subtraction operations don't return anything.
5. Writing and deploying a WSRF Web Service is easier than you might think. You just have to follow five simple steps.
6. Define the service's interface. This is done with WSDL
7. Implement the service. This is done with Java.
8. Define the deployment parameters. This is done with WSDD and JNDI
--- Content provided by FirstRanker.com ---
9. Compile everything and generate a GAR file. This is done with Ant
10. Deploy service. This is also done with a GT4 tool
Sample Code:
<?xml version="1.0" encoding="UTF-8"?>
<definitionsname="MathService"targetNamespace="http://www.globus.org/namespaces/examples/core/MathService_instance"
--- Content provided by FirstRanker.com ---
xmlns="http://schemas.xmlsoap.org/wsdl/"
xmlns:tns="http://www.globus.org/namespaces/examples/core/MathService_instance"
xmlns:wsdl="http://schemas.xmlsoap.org/wsdl/"
xmlns:wsrp="http://docs.oasis-open.org/wsrf/2004/06/wsrf-WS-ResourceProperties-1.2-draft-01.xsd"
xmlns:wsrpw="http://docs.oasis-open.org/wsrf/2004/06/wsrf-WS-
--- Content provided by FirstRanker.com ---
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
xmlns:wsdlpp="http://www.globus.org/namespaces/2004/10/WSDLPreprocessor"
xmlns:xsd="http://www.w3.org/2001/XMLSchema">
</definitions>
--- Content provided by FirstRanker.com ---
Result:
Thus the program for developing web service for new calculator was successfully executed.
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
Outcomes:
--- Content provided by FirstRanker.com ---
At the end of the course, the student should be able to
- Use the grid and cloud tool kits
- Design and implement applications on the Grid by using Web Service for new Calculator
Applications:
To make a calculator in Windows application using web service
--- Content provided by FirstRanker.com ---
Viva-voce
1) What is Web Service?
2) What are the advantages of web services?
3) What are the different types of web services?
4) What is SOAP?
--- Content provided by FirstRanker.com ---
5) What are the advantages of SOAP web services?
6) What are the disadvantages of SOAP web services?
7) What is WSDL?
8) What is UDDI?
9) What are RESTful web services?
--- Content provided by FirstRanker.com ---
10) What are the advantages of RESTful web services?
11) What is the difference between SOAP and REST web services?
12) What is SOA service architecture?
13) What tools are used to deploy web services?
14) What is Web Service architecture?
--- Content provided by FirstRanker.com ---
15) What are the advantages of web services in globus toolkit?
16) What are the different types of web services?
17) What is SOAP web services?
18) What is UDP and TCP?
19) What is stateless SOA?
--- Content provided by FirstRanker.com ---
20) What is data balancing in WSDL?
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
Expt.No. 02: DEVELOP NEW OGSA-COMPLIANT WEB SERVICE
Aim:
--- Content provided by FirstRanker.com ---
To develop a new OGSA-Compliant Web service in Grid Service using .NET language.
Software Requirements:
Globus Toolkit or equivalent Eucalyptus or Open Nebula or equivalent
Hardware Requirements:
Standalone desktops 30 Nos
--- Content provided by FirstRanker.com ---
Procedure:
1. Developed by the Global Grid Forum
2. Aims to define a common, standard, open architecture for Grid Applications.
3. Defines a set of rules that make up a grid service.
4. Sharing and Coordinated use of diverse resources in Dynamic VO's
--- Content provided by FirstRanker.com ---
Result:
Thus the program for developing OGSA- Complaint web service was successfully executed.
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
Outcomes:
--- Content provided by FirstRanker.com ---
At the end of the course, the student should be able to
- Use the grid and cloud tool kits
- Design and implement applications on the Grid to develop a new OGSA-Compliant Web service in Grid Service using .NET language
Applications:
- Sharing of information among diverse components of large heterogenous grid systems
- WAN
--- Content provided by FirstRanker.com ---
Viva-voce
1. How would you decide what style of Web Service to use? SOAP WS or REST?
2. Does the service expose data or business logic?
3. Do consumers and the service providers require a formal contract?
--- Content provided by FirstRanker.com ---
4. Do we need to support multiple data formats?
5. Do we need to make AJAX calls?
6. Is the call synchronous or asynchronous?
7. What level of security is required?
8. What level of transaction support is required?
--- Content provided by FirstRanker.com ---
9. Do we have limited band width?
10. What tools do you use to test your Web Services?
11. What is the difference between SOA and a Web service?
12. What is a microservice architecture (aka MSA)?
13. What is data integrity?
--- Content provided by FirstRanker.com ---
14. What is cloud infrastructure?
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
Expt.No. 03: USING APACHE AXIS DEVELOP A GRID SERVICE
Aim:
--- Content provided by FirstRanker.com ---
To develop a Grid service using Apache Axis
Software Requirements:
Globus Toolkit or equivalent Eucalyptus or Open Nebula or equivalent
Hardware Requirements:
Standalone desktops 30 Nos
--- Content provided by FirstRanker.com ---
Procedure:
1. Creating the New Level in the Package
2. Edit the Configuration Files
3. Modify the Service Code
4. Modify the Client
--- Content provided by FirstRanker.com ---
5. Compile and Deploy
6. Starting the Container
7. Compile the Client
8. Run the Client
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
--- Content provided by FirstRanker.com ---
Sample Output:
Addition was successful
Subtraction was successful
Multiplication was successful
--- Content provided by FirstRanker.com ---
Division was successful
Current value: 20.
Result:
Thus the program for Grid Service using Apache Axis was successfully executed.
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
--- Content provided by FirstRanker.com ---
Outcomes:
At the end of the course, the student should be able to
- Use the grid and cloud tool kits
- Design and implement applications on the Grid to develop a Grid service using Apache Axis
--- Content provided by FirstRanker.com ---
Applications:
- To create web service in Java
- To work with Globus Tool kit standards web service
Viva-voce
1. What are the different application integration styles?
--- Content provided by FirstRanker.com ---
2. What is Grid Computing?
3. What is QOS?
4. What are the derivatives of grid computing?
5. What are the features of data grids?
6. What is load balancing?
--- Content provided by FirstRanker.com ---
7. What is grid infrastructure?
8. Define – Distributed Computing.
9. Define - OSGI.
10. Define - OSGA.
11. What is the use of API's in cloud services?
--- Content provided by FirstRanker.com ---
12. What is the difference between cloud and grid?
13. What is data communication?
14. What are the elements of data communication?
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
--- Content provided by FirstRanker.com ---
Expt.No. 04: DEVELOP APPLICATIONS USING JAVA OR C/C++ GRID APIS
Aim:
To develop an application in Java using Grid APIs
Software Requirements:
Globus Toolkit or equivalent Eucalyptus or Open Nebula or equivalent
--- Content provided by FirstRanker.com ---
Hardware Requirements:
Standalone desktops 30 Nos
Procedure:
1. Import all the necessary java packages and name the file as GridLayoutDemo.java
2. Set up components to preferred size
--- Content provided by FirstRanker.com ---
3. Add buttons to experiment with Grid Layout
4. Add controls to set up horizontal and vertical gaps
5. Process the Apply gaps button press
6. Create the GUI
7. Create and set up the window,Set up the content pane and Display the Window
--- Content provided by FirstRanker.com ---
8. Schedule a job for the event dispatch thread
9. Show the application's GUI
Format No.: FirstRanker/Stud/LM/34/Issue:00/Revision:00
Sample Output:
--- Content provided by FirstRanker.com ---
1 2
3 4
5 6
Figure 1: Horizontal, Left-to-Right
2 1
--- Content provided by FirstRanker.com ---
4 3
6 5
Figure 2: Horizontal, Right-to-Left
This download link is referred from the post: Anna University B.Tech Lab Manual
--- Content provided by FirstRanker.com ---