A conceptual framework is presented for multi-scale field/network/agent-based modeling to support human and ecological health risk assessments. This framework is based on the representation of environmental dynamics in terms of interacting networks, agents that move across different networks, fields representing spatiotemporal distributions of physical properties, rules governing constraints and interactions, and actors that make decisions affecting the state of the system. Different deterministic and stochastic modeling case studies focusing on environmental exposures and associated risks are provided as examples, utilizing the bidirectional mapping between discrete, agent based approaches and continuous, equation based approaches. These examples include problems describing human health risk assessment, ecological risk assessment, and environmentally caused disease.