This book presents a semantic-based explainable framework based on knowledge graph and semantic web technology focusing on designing XAI system that transforms black-box AI model into a comprehensive and meaningful AI model for users. Researchers, students and professionals working in computer science will find this book useful.