我可以在Amazon Elastic MapReduce中运行.NET应用程序(或来自.NET dll的方法)吗?

时间:2021-06-19 09:28:19

What I need is a powerful machine that will run my .NET code one hour a day. I can't use EC2 cause it will loose all my data on shutdown. I need a virtual PC that I can start at specific time, and this PC should start my .exe/service/whatever automatically. Can I ask Amazon MapReduce to start a Windows instance and execute my code?

我需要的是一台功能强大的机器,它将每天运行一小时的.NET代码。我不能使用EC2因为它会在关机时丢失我的所有数据。我需要一台可以在特定时间启动的虚拟PC,这台PC应该自动启动我的.exe / service /。我可以要求Amazon MapReduce启动Windows实例并执行我的代码吗?

2 个解决方案

#1


Amazon MapReduce is a webservice for processing big chunk of data - not somewhere to run your .net code.

Amazon MapReduce是一个用于处理大块数据的Web服务 - 而不是运行.net代码的地方。

EC2 is virtual server hosting - can you save your data to an external webservice, on your own machine, or S3? This library is available from .net: http://developer.amazonwebservices.com/connect/entry.jspa?externalID=129

EC2是虚拟服务器托管 - 您可以将数据保存到外部Web服务,自己的计算机或S3上吗?该库可从.net获得:http://developer.amazonwebservices.com/connect/entry.jspa?externalID = 129

#2


Amazon Elastic MapReduce is designated to be integrated with EC2 and S3, providing the infrastructure for intense data processing applications.

Amazon Elastic MapReduce被指定与EC2和S3集成,为强大的数据处理应用程序提供基础架构。

MapReduce is centered around the concept of Job Flow, where each Job can contain one or more steps. Each step takes some data from S3, distributes it to the EC2 instances configured and then writes the results back to S3.

MapReduce以作业流的概念为中心,其中每个作业可以包含一个或多个步骤。每个步骤从S3获取一些数据,将其分配给配置的EC2实例,然后将结果写回S3。

So basically you're supposed to upload your application and data to S3, then configure how many and what type of EC2 instances you want, specify the location of your application and your data on S3 and then start the job. There are several ways in which you can start the job: either logging in to the AWS Management Console, or using the exisitng APIs or the Command Line tools.

所以基本上你应该将你的应用程序和数据上传到S3,然后配置你想要的EC2实例的数量和类型,在S3上指定应用程序和数据的位置然后开始工作。您可以通过多种方式开始工作:登录AWS管理控制台,或使用exisitng API或命令行工具。

There is also a C# Library for MapReduce available from Amazon that can help.

亚马逊还提供了一个可以提供帮助的MapReduce C#库。

However, you should note that your application needs to employ to MapReduce programming model to be able to run distributedly, so you can't really just run any .Net code.

但是,您应该注意到您的应用程序需要使用MapReduce编程模型才能够分布式运行,因此您不能真正运行任何.Net代码。

There's another post here with some good answers relating to .Net frameworks in regards to the MapReduce implementation.

这里有另一篇文章,其中有关于MapReduce实现的.Net框架的一些很好的答案。

#1


Amazon MapReduce is a webservice for processing big chunk of data - not somewhere to run your .net code.

Amazon MapReduce是一个用于处理大块数据的Web服务 - 而不是运行.net代码的地方。

EC2 is virtual server hosting - can you save your data to an external webservice, on your own machine, or S3? This library is available from .net: http://developer.amazonwebservices.com/connect/entry.jspa?externalID=129

EC2是虚拟服务器托管 - 您可以将数据保存到外部Web服务,自己的计算机或S3上吗?该库可从.net获得:http://developer.amazonwebservices.com/connect/entry.jspa?externalID = 129

#2


Amazon Elastic MapReduce is designated to be integrated with EC2 and S3, providing the infrastructure for intense data processing applications.

Amazon Elastic MapReduce被指定与EC2和S3集成,为强大的数据处理应用程序提供基础架构。

MapReduce is centered around the concept of Job Flow, where each Job can contain one or more steps. Each step takes some data from S3, distributes it to the EC2 instances configured and then writes the results back to S3.

MapReduce以作业流的概念为中心,其中每个作业可以包含一个或多个步骤。每个步骤从S3获取一些数据,将其分配给配置的EC2实例,然后将结果写回S3。

So basically you're supposed to upload your application and data to S3, then configure how many and what type of EC2 instances you want, specify the location of your application and your data on S3 and then start the job. There are several ways in which you can start the job: either logging in to the AWS Management Console, or using the exisitng APIs or the Command Line tools.

所以基本上你应该将你的应用程序和数据上传到S3,然后配置你想要的EC2实例的数量和类型,在S3上指定应用程序和数据的位置然后开始工作。您可以通过多种方式开始工作:登录AWS管理控制台,或使用exisitng API或命令行工具。

There is also a C# Library for MapReduce available from Amazon that can help.

亚马逊还提供了一个可以提供帮助的MapReduce C#库。

However, you should note that your application needs to employ to MapReduce programming model to be able to run distributedly, so you can't really just run any .Net code.

但是,您应该注意到您的应用程序需要使用MapReduce编程模型才能够分布式运行,因此您不能真正运行任何.Net代码。

There's another post here with some good answers relating to .Net frameworks in regards to the MapReduce implementation.

这里有另一篇文章,其中有关于MapReduce实现的.Net框架的一些很好的答案。