Skip to content

orf53975/hadoop.net

 
 

Repository files navigation

Disclaimer: The bits are super raw and the solution doesn't even compile, much less run. This is a WIP

This is a .NET port of The Apache Hadoop project v2.7.2 It is targeted for .NET 4.6.1 using C# 6 but the ultimate goal is to use .NET core for xplat. Please note that this is only the core Hadoop platform and as such it doesn't include the other components in the ecosystem such as Hive, Pig, Oozie, Flume etc. Below is a plan of action to get it up & running

1. Hadoop.Common has the core code for IO, HDFS, Yarn and Mapreduce. Clean this up first and make all tests pass

2. Hadoop.HDFS is the filesystem port. This needs to be taken up next

3. Get Hadoop.Yarn working followed by Hadoop.MapReduce

4. Work on porting ZooKeeper so it can be used as the orchestrator

5. Work on Hadoop.Tools to get the framework running on aws, openstack etc

About

.NET port of hadoop core

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C# 98.3%
  • C 1.4%
  • Shell 0.1%
  • AspectJ 0.1%
  • HTML 0.1%
  • JavaScript 0.0%