Yes the web.config file as well as Import directives and other portions of ASP.net are case sensitive. If you are using a case insensitive programming language some of this may change. Please consult the .NET Framework documentation for more details on this matter.
Content retrieved from: https://support.appliedi.net/kb/a379/is-asp_net-case-sensitive.aspx.