大数据CloudSim应用实践

CloudSimExampleA.java

1准备
1.1操作系统
本实验在Windows 7 或Windows 10系统运行均可。

1.2软件
cloudsim-3.0.3.zip；
commons-math3-3.2-bin.zip；
jdk-8u152-windows-x64.exe；
eclipse-jee-neon-3-win32-x86_64
所需资料链接：https://pan.baidu.com/s/1AE4UsmFW0rOny6BFCQiPMA?pwd=2023
2安装JDK
2.1安装JDK
双击运行jdk-8u152-windows-x64.exe。
在这里插入图片描述

在上面对话框中选择默认目录或更改目录安装。

在这里插入图片描述

3配置Eclipse集成开发环境
3.1启动Eclipse
运行…\eclipse-jee-neon-3-win32-x86_64\eclipse目录下的eclipse.exe可执行文件。
注意：首次运行eclipse会提示选择WorkSpace，及工作目录，用于存放项目文件，根据自己情况选择一个文件夹即可。
在这里插入图片描述

3.2配置Java运行时环境JRE
在上一步打开的Eclipse集成开发环境窗口中，点击菜单“Window”“Preferences”菜单项：

在这里插入图片描述
打开“Preferences”对话框：

在“Preferences”窗口中点击“Java”左侧箭头，再点击其下方弹出的“Installed JREs”的左侧箭头（下面这幅图可能不一样，因为我当前这一步已经设置过，故“Installed JRE”中会有内容）：
在这里插入图片描述

点击右侧窗口中的“Add”按钮，打开“Add JRE”窗口。
在这里插入图片描述

选择“Standard VM”项，点击下方“Next”按钮，在接下来的对话框中点击“Directory”按钮：
在这里插入图片描述

在弹出的“浏览文件夹”对话框中选择Java运行时环境所在的路径C:\Program Files\Java\jre1.8.0_152（视自己JDK具体安装路径而定）：
在这里插入图片描述

点击“确定”按钮返回。
4创建Java项目
4.1创建项目
在Eclipse集成开发窗口中，单击“File”“New”“Java Project”，新建Java项目，命名为“CloudSim”：
在这里插入图片描述

一直点击“Next”或“Finish”按钮即可。
4.2导入jar包
4.2.1导入CloudSim开发包
4.2.1.1.1解压CloudSim开发包
需要使用的CloudSim API在cloudsim-3.0.3.jar包中，该jar包可通过解压cloudsim-3.0.3.zip得到，位于解压后的…\cloudsim-3.0.3\jars文件夹下。
在这里插入图片描述

4.2.1.1.2导入CloudSim开发包
在Eclipse中，在左侧树状结构中，右键单击“CloudSim”项目，选择“Build Path”“Add External Archive”，导入cloudsim-3.0.3.jar。
在这里插入图片描述

4.2.2导入math库
4.2.2.1.1解压math库
因本项目中用到了math里面的类，需要引入commons-math3-3.2.jar这个库。此库通过解压commons-math3-3.2-bin.zip文件可以得到。
4.2.2.1.2导入math库
在Eclipse中，右键单击“CloudSim”项目，选择“Build Path”“Add External Archive”，导入commons-math3-3.2.jar。
4.3运行测试程序
4.3.1导入测试程序代码
CloudSim提供的实例程序放在CloudSim\cloudsim-3.0.3\examples\org\cloudbus\cloudsim\examples目录下。
在这里插入图片描述

在以上examples文件夹中复制CloudSimExample6.java文件，在Eclipse中的“Package Explorer”树形结构中，展开“CloudSim” “src”，右键点击“src”文件夹，在弹出的上下文菜单中选择“Paste”菜单，将CloudSimExample6.java复制到工程中。
在这里插入图片描述

4.3.2修改错误
复制后CloudSimExample6.java文件显示效果及位置如下：
在这里插入图片描述

可以看出其位于“default package”默认包中。但注意上图中CloudSimExample6.java文件前面的图标左下角有个红色的“×”符号，意思是CloudSimExample6.java代码中有错误。接下来排除错误。
在Eclipse中双击CloudSimExample6.java文件，在右侧编辑窗口中打开它。
在这里插入图片描述

可以看到这条语句package org.cloudbus.cloudsim.examples;中有红色波浪下划线，表明有语法问题。鼠标放到该语句上，显示：
在这里插入图片描述

点击2行蓝色文字中的第一行，“Move ‘CloudSimExample6.java to package org.cloudbus.cloudsim.examples’”，表示将CloudSimExample6.java文件放到Eclipse窗口左面的树形结构的org.cloudbus.cloudsim.examples包中。这样代码中原先带红色波浪线的语句就与实际的包（代码的存放位置）相符，其错误得到了修改。修改之后的效果如下：
在这里插入图片描述

包的存放文件夹与包的对应关系（此图仅为帮助理解）：
在这里插入图片描述

4.3.3运行
保证右侧编辑区当前活动（当前正在编辑状态）的窗口为CloudSimExample6.java。
点击工具栏上的绿色三角形按钮Run AsJava Application Alt+Shift+X,J，运行程序，如图：
在这里插入图片描述

5数据中心仿真实例
5.1导入实例代码
1.将我随本Word文档打包的CloudSimExampleA.java代码导入项目，具体步骤同4.3.1，不同的是由原来导入CloudSimExample6.java文件，改为现在导入CloudSimExampleA.java文件。
2.遵照4.3.2步骤将CloudSimExampleA放到org.cloudbus.cloudsim.examples包中，如下图。
在这里插入图片描述

5.2运行

附CloudSimExampleA.java代码：

/** Title:        CloudSim Toolkit* Description:  CloudSim (Cloud Simulation) Toolkit for Modeling and Simulation*               of Clouds* Licence:      GPL - http://www.gnu.org/copyleft/gpl.html** Copyright (c) 2009, The University of Melbourne, Australia*/package org.cloudbus.cloudsim.examples;//qiuzhuli, 2023-06-11import java.text.DecimalFormat;
import java.util.ArrayList;
import java.util.Calendar;
import java.util.LinkedList;
import java.util.List;import org.cloudbus.cloudsim.Cloudlet;
import org.cloudbus.cloudsim.CloudletSchedulerTimeShared;
import org.cloudbus.cloudsim.Datacenter;
import org.cloudbus.cloudsim.DatacenterBroker;
import org.cloudbus.cloudsim.DatacenterCharacteristics;
import org.cloudbus.cloudsim.Host;
import org.cloudbus.cloudsim.Log;
import org.cloudbus.cloudsim.Pe;
import org.cloudbus.cloudsim.Storage;
import org.cloudbus.cloudsim.UtilizationModel;
import org.cloudbus.cloudsim.UtilizationModelFull;
import org.cloudbus.cloudsim.Vm;
import org.cloudbus.cloudsim.VmAllocationPolicySimple;
import org.cloudbus.cloudsim.VmSchedulerTimeShared;
import org.cloudbus.cloudsim.core.CloudSim;
import org.cloudbus.cloudsim.provisioners.BwProvisionerSimple;
import org.cloudbus.cloudsim.provisioners.PeProvisionerSimple;
import org.cloudbus.cloudsim.provisioners.RamProvisionerSimple;/*** An example showing how to create* scalable simulations.*/
//public class CloudSimExample6 {//qiuzhuli, 2023-06-11
public class CloudSimExampleA {//qiuzhuli, 2023-06-11/** The cloudlet list. */private static List<Cloudlet> cloudletList;/** The vmlist. */private static List<Vm> vmlist;//private static List<Vm> createVM(int userId, int vms) {//qiuzhuli, 2023-06-11private static List<Vm> createVM(int userId, int mips[]) {//qiuzhuli, 2023-06-11//Creates a container to store VMs. This list is passed to the broker laterLinkedList<Vm> list = new LinkedList<Vm>();//VM Parameterslong size = 10000; //image size (MB)int ram = 512; //vm memory (MB)//int mips = 1000;//qiuzhuli, 2023-06-11long bw = 1000;int pesNumber = 1; //number of cpusString vmm = "Xen"; //VMM name//create VMs//Vm[] vm = new Vm[vms];//qiuzhuli, 2023-06-11Vm[] vm = new Vm[mips.length];//qiuzhuli, 2023-06-11for(int i=0;i<mips.length;i++){//vm[i] = new Vm(i, userId, mips, pesNumber, ram, bw, size, vmm,//qiuzhuli, 2023-06-11 //new CloudletSchedulerTimeShared());//qiuzhuli, 2023-06-11vm[i] = new Vm(i, userId, mips[i], pesNumber, ram, bw, size, vmm, new CloudletSchedulerTimeShared());//qiuzhuli, 2023-06-11//for creating a VM with a space shared scheduling policy for cloudlets://vm[i] = Vm(i, userId, mips, pesNumber, ram, bw, size, priority, vmm, new CloudletSchedulerSpaceShared());list.add(vm[i]);}return list;}//private static List<Cloudlet> createCloudlet(int userId, int cloudlets){//qiuzhuli, 2023-06-11private static List<Cloudlet> createCloudlet(int userId, long cloudlets[]){//qiuzhuli, 2023-06-11// Creates a container to store CloudletsLinkedList<Cloudlet> list = new LinkedList<Cloudlet>();//cloudlet parameters//long length = 1000;//qiuzhuli, 2023-06-11long fileSize = 300;long outputSize = 300;int pesNumber = 1;UtilizationModel utilizationModel = new UtilizationModelFull();//Cloudlet[] cloudlet = new Cloudlet[cloudlets];//qiuzhuli, 2023-06-11Cloudlet[] cloudlet = new Cloudlet[cloudlets.length];//qiuzhuli, 2023-06-11//for(int i=0;i<cloudlets;i++){//qiuzhuli, 2023-06-11for(int i=0;i<cloudlets.length;i++){/*cloudlet[i] = new Cloudlet(i, length, pesNumber, fileSize, outputSize, utilizationModel, utilizationModel, utilizationModel);*///qiuzhuli, 2023-06-11cloudlet[i] = new Cloudlet(i, cloudlets[i], pesNumber, fileSize, outputSize, utilizationModel, utilizationModel, utilizationModel);//qiuzhuli, 2023-06-11// setting the owner of these Cloudletscloudlet[i].setUserId(userId);list.add(cloudlet[i]);}return list;}// STATIC METHODS ////*** Creates main() to run this example*/public static void main(String[] args) {//Log.printLine("Starting CloudSimExample6...");//qiuzhuli, 2023-06-11Log.printLine("Starting CloudSimExampleA...");//qiuzhuli, 2023-06-11try {// First step: Initialize the CloudSim package. It should be called// before creating any entities.int num_user = 1;   // number of grid usersCalendar calendar = Calendar.getInstance();boolean trace_flag = false;  // mean trace events// Initialize the CloudSim libraryCloudSim.init(num_user, calendar, trace_flag);// Second step: Create Datacenters//Datacenters are the resource providers in CloudSim. We need at list one of them to run a CloudSim simulation@SuppressWarnings("unused")Datacenter datacenter0 = createDatacenter("Datacenter_0");@SuppressWarnings("unused")Datacenter datacenter1 = createDatacenter("Datacenter_1");//Third step: Create BrokerDatacenterBroker broker = createBroker();int brokerId = broker.getId();//Fourth step: Create VMs and Cloudlets and send them to broker/*vmlist = createVM(brokerId,20); //creating 20 vmscloudletList = createCloudlet(brokerId,40); // creating 40 cloudlets*/int mips[] = {278,289,132,209,286,333,212,423};//虚拟机的CPU性能（mips）//qiuzhuli, 2023-06-11/*所需的指令数*/long cloudlets[] = new long[] {19365, 49809, 30218, 44157, 16754, 18336,20045, 31493, 30727, 31017, 59008, 32000, 46790, 77779, 93467, 67853};//qiuzhuli, 2023-06-11//vmlist = createVM(brokerId,20); //creating 20 vms//qiuzhuli, 2023-06-11vmlist = createVM(brokerId, mips); //creating 20 vms//qiuzhuli, 2023-06-11//cloudletList = createCloudlet(brokerId,40); // creating 40 cloudlets//qiuzhuli, 2023-06-11cloudletList = createCloudlet(brokerId, cloudlets); // creating 40 cloudlets//qiuzhuli, 2023-06-11broker.submitVmList(vmlist);broker.submitCloudletList(cloudletList);// Fifth step: Starts the simulationCloudSim.startSimulation();// Final step: Print results when simulation is overList<Cloudlet> newList = broker.getCloudletReceivedList();CloudSim.stopSimulation();printCloudletList(newList);//Log.printLine("CloudSimExample6 finished!");//qiuzhuli, 2023-06-11Log.printLine("CloudSimExampleA finished!");//qiuzhuli, 2023-06-11}catch (Exception e){e.printStackTrace();Log.printLine("The simulation has been terminated due to an unexpected error");}}private static Datacenter createDatacenter(String name){// Here are the steps needed to create a PowerDatacenter:// 1. We need to create a list to store one or more//    MachinesList<Host> hostList = new ArrayList<Host>();// 2. A Machine contains one or more PEs or CPUs/Cores. Therefore, should//    create a list to store these PEs before creating//    a Machine.List<Pe> peList1 = new ArrayList<Pe>();int mips = 1000;// 3. Create PEs and add these into the list.//for a quad-core machine, a list of 4 PEs is required:peList1.add(new Pe(0, new PeProvisionerSimple(mips))); // need to store Pe id and MIPS RatingpeList1.add(new Pe(1, new PeProvisionerSimple(mips)));peList1.add(new Pe(2, new PeProvisionerSimple(mips)));peList1.add(new Pe(3, new PeProvisionerSimple(mips)));//Another list, for a dual-core machineList<Pe> peList2 = new ArrayList<Pe>();peList2.add(new Pe(0, new PeProvisionerSimple(mips)));peList2.add(new Pe(1, new PeProvisionerSimple(mips)));//4. Create Hosts with its id and list of PEs and add them to the list of machinesint hostId=0;int ram = 2048; //host memory (MB)long storage = 1000000; //host storageint bw = 10000;hostList.add(new Host(hostId,new RamProvisionerSimple(ram),new BwProvisionerSimple(bw),storage,peList1,new VmSchedulerTimeShared(peList1))); // This is our first machinehostId++;hostList.add(new Host(hostId,new RamProvisionerSimple(ram),new BwProvisionerSimple(bw),storage,peList2,new VmSchedulerTimeShared(peList2))); // Second machine//To create a host with a space-shared allocation policy for PEs to VMs://hostList.add(//		new Host(//			hostId,//			new CpuProvisionerSimple(peList1),//			new RamProvisionerSimple(ram),//			new BwProvisionerSimple(bw),//			storage,//			new VmSchedulerSpaceShared(peList1)//		)//	);//To create a host with a oportunistic space-shared allocation policy for PEs to VMs://hostList.add(//		new Host(//			hostId,//			new CpuProvisionerSimple(peList1),//			new RamProvisionerSimple(ram),//			new BwProvisionerSimple(bw),//			storage,//			new VmSchedulerOportunisticSpaceShared(peList1)//		)//	);// 5. Create a DatacenterCharacteristics object that stores the//    properties of a data center: architecture, OS, list of//    Machines, allocation policy: time- or space-shared, time zone//    and its price (G$/Pe time unit).String arch = "x86";      // system architectureString os = "Linux";          // operating systemString vmm = "Xen";double time_zone = 10.0;         // time zone this resource locateddouble cost = 3.0;              // the cost of using processing in this resourcedouble costPerMem = 0.05;		// the cost of using memory in this resourcedouble costPerStorage = 0.1;	// the cost of using storage in this resourcedouble costPerBw = 0.1;			// the cost of using bw in this resourceLinkedList<Storage> storageList = new LinkedList<Storage>();	//we are not adding SAN devices by nowDatacenterCharacteristics characteristics = new DatacenterCharacteristics(arch, os, vmm, hostList, time_zone, cost, costPerMem, costPerStorage, costPerBw);// 6. Finally, we need to create a PowerDatacenter object.Datacenter datacenter = null;try {datacenter = new Datacenter(name, characteristics, new VmAllocationPolicySimple(hostList), storageList, 0);} catch (Exception e) {e.printStackTrace();}return datacenter;}//We strongly encourage users to develop their own broker policies, to submit vms and cloudlets according//to the specific rules of the simulated scenarioprivate static DatacenterBroker createBroker(){DatacenterBroker broker = null;try {broker = new DatacenterBroker("Broker");} catch (Exception e) {e.printStackTrace();return null;}return broker;}/*** Prints the Cloudlet objects* @param list  list of Cloudlets*/private static void printCloudletList(List<Cloudlet> list) {int size = list.size();Cloudlet cloudlet;String indent = "    ";Log.printLine();Log.printLine("========== OUTPUT ==========");Log.printLine("Cloudlet ID" + indent + "STATUS" + indent +"Data center ID" + indent + "VM ID" + indent + indent + "Time" + indent + "Start Time" + indent + "Finish Time");DecimalFormat dft = new DecimalFormat("###.##");for (int i = 0; i < size; i++) {cloudlet = list.get(i);Log.print(indent + cloudlet.getCloudletId() + indent + indent);if (cloudlet.getCloudletStatus() == Cloudlet.SUCCESS){Log.print("SUCCESS");Log.printLine( indent + indent + cloudlet.getResourceId() + indent + indent + indent + cloudlet.getVmId() +indent + indent + indent + dft.format(cloudlet.getActualCPUTime()) +indent + indent + dft.format(cloudlet.getExecStartTime())+ indent + indent + indent + dft.format(cloudlet.getFinishTime()));}}}
}