Computing quantum entanglement with machine learning