Skip to content

Latest commit

 

History

4 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MRJobCC

A MRJob Connected Component implementation of paper proposed in Connected Components in MapReduce and Beyond.

Example

for the graph in test.dot: graph,

getting connected components with networkx:

>>> sorted(nx.connected_components(g), key = len, reverse=True)
[{'1', '5', '7', '8', '9'}, {'2', '3', '4', '6'}]

with mrjobcc, simply run:

python runner.py test.dot

will get you same result, but thanks to MRJob, it will just work on Amazon EMR.

Author

About

Connected Component in MRJob

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages